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Invitation to Join 



The Association for the Advancement of Computing in Education (AACE) is an 
international, non-profit educational organization. The Association's purpose is to advance 
the knowledge, theory, and quality of teaching and learning at all levels with information 
technology. This purpose is accomplished through the encouragement of scholarly inquiry 
related to technology in education and the dissemination of research results and their applications 
through AACE sponsored publications, conferences, and other opportunities for professional growth. 

AACE members have the opportunity to participate in topical and regional divisions/societies/chapters, high-quality 
peer-reviewed publications, and conferences. 

Join with fellow professionals from around the world to share knowledge and ideas on research, 
development, and applications in information technology and education. AACE’s membership 
includes researchers, developers, and practitioners in schools, colleges, and universi- 
ties; administrators, policy decision-makers, professional trainers, adult educators, 
and other specialists in education, industry, and government with an interest in 
advancing knowledge and learning with information technology in education. 



Membership Benefit Highlights 

■1 Gain professional recognition by participating in AACE sponsored 
international conferences 

■I Enhance your knowledge and professional skills through interaction 
with colleagues from around the world 

■I Learn from colleagues ' research and studies by receiving AACE’s 
well-respected journals and books 

■i Receive a subscription to the Professional Member periodical 
Educational Technology Review 

■i Receive discounts on multiple journal subscriptions , conference 
registration fees , proceedings books & CD-ROMs 
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□ Journals 



Abstracts for all journal issues are available at www.aace.org/pubs 



Educational Technology Review 

International Forum on Educational Technology Issues & Applications 

(ETR) ISSN# 1065-6901 

AACE's member journal is the focal point for 
AACE members to exchange information 
between disciplines, educational levels, and 
information technologies. It's purpose is to 
stimulate the growth of ideas and practical 
solutions which can contribute toward the 
improvement of education through informa- 
tion technology. All AACE Professional and 
Student Members receive £77?as a benefit of 
membership. 
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WebNet Journal 

Internet Technologies, Applications & Issues 

ISSN# 1522-1 92X Quarterly 

Focused on WWW, Internet, and Intranet- 
based technologies, applications, research, 
and issues, the WebNet Journal is an inno- 
vative collaboration between the top acad- 
emic and corporate laboratory researchers, 
developers, and end-users. Columnists 
offer how-to articles and expert commen- 
tary on the latest developments. 




Journal of Educational Multimedia and Hypermedia Journal of Computers in Mathematics & Science Teaching 

(JEMH) ISSN# 1055-8896 Quarterly (JCMST) ISSN# 0731-9258 Quarterly 




Designed to provide a multidisciplinary forum to 
present and discuss research, development and 
applications of multimedia and hypermedia in edu- 
cation. The main goal of the Journal is to con- 
tribute to the advancement of the theory and prac- 
tice of learning and teaching using these powerful 
and promising technological tools that allow the 
integration of images, sound, text, and data. 




JCMST is the only periodical devoted specifically 
to using information technology in the teaching of 
mathematics and science. The Journal offers an 
in-depth forum for the exchange of information in 
the fields of science, mathematics, and computer 
science. 



Journal of Interactive Learning Research 

(JILR) ISSN# 1093-023X Quarterly 



Journal of Technology and Teacher Education 

(JTATE) ISSN# 1059-7069 Quarterly 



Journal Of 

Interactive 

Learning 

Research 
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The Journal's published papers relate to the under- 
lying theory, design, implementation, effectiveness, 
and impact on education and training of the follow- 
ing interactive learning environments: authoring sys- 
tems, CALL, assessment systems, CBT, computer- 
mediated communications, collaborative learning, 
distributed learning environments, performance 
support systems, multimedia systems, simulations 
and games, intelligent agents on the Internet, intelli- 
gent tutoring systems, micro-worlds, and virtual 
reality based learning systems. 




A forum for the exchange of knowledge about the 
use of information technology in teacher educa- 
tion. Journal content covers preservice and inser- 
vice teacher education, graduate programs in 
areas such as curriculum and instruction, educa- 
tional administration, staff development, instruc- 
tional technology, and educational computing. 



International Journal of Educational Telecommunications 

(IJET) ISSN# 1077-9124 Quarterly 

IJET serves as a forum to facilitate the interna- 
tional exchange of information on the current 
theory, research, development, and practice of 
telecommunications in education and training. 
This journal is designed for researchers, devel- 
opers and practitioners in schools, colleges, and 
universities, administrators, policy decision- 
makers, professional trainers, adult educators, 
and other specialists in education, industry, and 
government. 



Information Technology in Childhood Education Annual 

(ITCE) ISSN# 1522-8185 

A primary information source and forum to report 
the research and applications for using informa- 
tion technology in the education of children — 
early childhood, preschool, and elementary. The 
annual is a valuable resource for all educators 
who use computers with children. 
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Conferences 



Details for conferences are available at www.aace.org/conf 



The exchange of ideas and experiences is essential to the advancement of the field and the professional growth of AACE mem- 
bers. AACE sponsors conferences each year where members learn about research, developments, and applications in their 
fields, have an opportunity to participate in papers, panels, poster/demonstrations and workshops, and meet invited speakers. 



ED-MEDIA 



2000 



World Conference on 
Educational Multimedia, 
Hypermedia & Telecommunications 




WebNet 




World Conference 




JUNE 26- JULY 1, 2000 • MONTREAL, CANADA 
JUNE 25-30, 2001 • TAMPERE, FINLAND 

ED-MEDIA - World Conference on Educational 
Multimedia, Hypermedia & 
Telecommunications 

This annual conference serves as a multidisciplinary forum for the dis- 
cussion of the latest research, developments, and applications of multi- 
media, hypermedia, and telecommunications for all levels of education. 



OCT. 30-N0V. 4, 2000 • SAN ANTONIO, TX USA 

WebNet - World Conference on the WWW & Internet 

This annual conference facilitates the exchange of information in these major 
topics: Commercial, Business, Professional, and Community Applications; 
Education Applications; Electronic Publishing and Digital Libraries; 
Ergonomic, Interface, and Cognitive Issues; General Web Tools and Facilities; 
Medical Applications of the Web; Personal Applications and Environments; 
Societal Issues, including Legal, Standards, and International Issues; and 
Web Technical Facilities. 
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Teacher 
Ed u catio n 



12 th international 

CONFERENCE 



MARCH 3-6, 2001 • ORLANDO, FL USA 

M/SET - International Conference on Mathematics/ 
Science Education & Technology 

The conference focuses upon information technology in mathematics, 
science and computer science education across all levels and settings, 
including elementary, secondary, college, and teacher education. Learn 
about the current research, development, classroom applications, issues, 
theory, and trends. 



MARCH 6-10, 2001 • ORLANDO, FL USA 

SITE - Society for Information Technology and 

Teacher Education International Conference 

This conference, held annually, offers opportunities to share ideas and 
expertise on all topics related to the use of information technology in 
teacher education and instruction about information technology for all 
disciplines in preservice, inservice, and graduate teacher education. 



Co-Sponsored Conferences 



ICCE/ICCAI — International Conference on Computers in Education/International Conference on Computer- 
Assisted Instruction 

ICCE/ICCAI is an annual event focusing on a broad spectrum of interdisciplinary research topics concerned with theories, technologies and practices of 
applying computers in education. It provides a forum for interchange among educators, cognitive and computer scientists, and practitioners throughout 
the world, especially from the Asia-Pacific region. 

NOVEMBER 21-24, 2000 • TAIPEI, TAIWAN 
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Applications 17 

Kenneth S . Manning, Ph.D., Rensselaer Polytechnic Institute, USA 

Student-Instructor E-mail Exchange in Active-Learning Biol 100 17 

Gili Marbach-Ad, University of Maryland Baltimore County, USA; Phillip G. Sokolove, University of 
Maryland Baltimore County, USA 

Developing Prairie to Mountain Explorer: A GIS and Remote Sensing Data Set for the Fifth- 
Twelfth Grade Classroom 17 

Patricia McClurg, University of Wyoming, USA; Alan Buss, University of Wyoming 

Math and Science Software for the Young Child: Developomentally Approporiate or 

Marketing Ploy? 17 

Robin McGrew-Zoubi, Sam Houston State University, USA; Joan Livingston Prouty, Sam Houston 
State University, USA; Kim Arp, Sam Houston State University, USA 

Modelling Three-Dimensional Surfaces On A Spreadsheet 18 

Abas Md Said, Universiti Teknologi Petronas, Malaysia; Mohd Yunus Nay an, Universiti Teknologi 
Petronas, Malaysia 

LAAP: Learn Anytime Anywhere Physics I 18 

Jerry Meisner, UNCGreensboro, USA; Harol Hoffman, UNCGreensboro, USA; Mike Strickland, U. 

Washington, USA; Wolfgang Christian, Davidson College, USA; Aaron Titus, NCA&T, USA 

Inservice programs: Does Their Effectiveness Last? 18 

Michelle Merriweather, West Chester University, USA 

Quantitative courses in distance learning 18 

Antoni Meseguer-Artola, Universitat Oberta de Catalunya, Spain 

Discovering xy Algebra: Intelligent Interactive Internet Instruction 18 

John Miller, The City College of CUNY, USA 

Discovering xy Algebra: Intelligent Interactive Internet Instruction 19 

John Miller, The City College of CUNY, USA 

Building and Using Simulation Based Environments for Learning about Complex Domains 19 

Marcelo Milrad, The Institute for Media Technology, SWEDEN; J. Michael Spector, University of 
Bergen, Norway; Pal Davidsen, University of Bergen, Norway 

Using Controls to Construct Dynamic Spreadsheets for Teaching Math and Physics: the 
Design of Interfaces and Worksheets 19 

Simon Mochon, Center for Research and Advanced Studies, IPN, Mexico; 

Science education in alternative programs: Building bridges with technology 19 

Barbara Moore, The University of South Florida, USA 

The Effects of Technology on an Undergraduate Mathematics Department 20 

Leigh Myers, Northwestern State University of Louisiana, USA; Stan Chadick, Northwestern State 
University of Louisiana, USA 

Mining The Internet: Integrating Real-World Data And Interactivity In The Online Classroom 20 

Gerald "Jerry” Nelson, Casper College, USA; Susan Nelson, Casper College, USA 

A Computer Simulator Can Transform "Dictums of Authority" into "Evidence" for Model 
Construction in Physics 20 

Valerie Otero, San Deigo State University, USA; Fred Goldberg, San Diego State University, USA 

From the abstract to the practical: How the Motion Media Grapher helps students 

understand and interpret abstract mathematical concepts 20 

Evangeline S . Pianfetti, University of Illinois, College of Education, USA; Brian Pianfetti, University 
of Illinois, College of Education, USA 

Issues Involved in a Large Scale Implementation of Web-Based Mathematics Instruction 20 

Michael Pilant, Texas A&M University, USA; Robert Hall, Texas A&M University, USA; Janice 
Epstein, Texas A&M University, USA; Yvette Hester, Texas A&M University, USA; Arlen Strader, 

Texas A&M University, USA 



Technological Tools to Enhance Performance in Calculus 1 21 

Olga M. Ramirez, University of Texas- Pan American, USA; John E. Bernard, University of Texas-P an 
American, USA; William Heller, University of Texas-Pan American, USA; Wendy A. Lawrence- 
Fowler, University of Texas-Pan American, USA; Gerald Brazier, University of Texas-Pan American, 

USA 

The application of Maple V in learning activities for courses in transport phenomena 21 

Araceli Reyes, Instituto Tecnologico Autonomo De Mexico, Mexico; Bernardo Hernandez-Morales, 

Universidad Nacional Autonoma De Mexico, Mexico 

Math/Science/Technology: An Academic Major 21 

Timothy Riegle, Kean University, USA 

Flexible Generation of Animations Using Animal 21 

Guido Roessling, University of Siegen, Germany; Bernd Freisleben, University of Siegen, Germany 

Hypertexts and Hypermedia to Present the Interconnections Between Mathematics and 

Arts 22 

Nicoletta Sala, Academy of arch- University of Italian Switzerland, Switzerland 

Mathematics, Arts, and New Media : Some Interesting Interconnections 22 

Nicoletta Sala, Academy of Arch. - University of Italian Switzerland, Switzerland 

ZELIG: Statistics For All 22 

Teresa Sancho, Universitat Oberta de Catalunya, Catalunya; Antoni Meseguer, Universitat Oberta de 
Catalunya, Catalunya; Francesc Vallverdu, Universitat Oberta de Catalunya, Catalunya; Eloi Batlle, 
Universitat Oberta de Catalunya 

Evaluation of Web-Based Instruction: A Case Study in Brazilian High Schools 22 

Dietrich Schiel, University of Sao Paulo, Brazil; Joan Dassin, Fulbright Comission, United States; 

Monica Magalhaes, Sao Paulo State University, Brazil; Iria Guerrini, University of Sao Paulo, Brazil 

Realizing an IDEA/ Computer-aided instruction and learning 23 

W. Udo Schroeder, Univ. Rochester, USA 

Computer Enhanced Learning Environments for Meta-Competencies in Software 

Engineering 23 

Mildred Shaw, University of Calgary, Canada; Brian Gaines, University of Calgary, Canada 

Using Graphing Software, Computers And Ekg's To Help Students Learn About The 

Behavior Of The Heart 23 

Leonard Simons, Elmira College, USA; Jerry Przybylski, Elmira College, USA 

Grades 4 and 5 Teachers* Perceptions of Technology Implementation in Mathematics 
Instruction 23 

Scott W. Slough, Georgia Southern University, USA; Gregory E. Chamblee, Georgia Southern 
University, USA 

I. MO. PHY. a net-course supporting the Introduction to Modeling in Physics education at 

high school level 24 

Rosa Maria Sperandeo-Mineo, University of Palermo, Italy 

Interactive Distance Education: A Database Model to Facilitate Peer Interaction for 
Asynchronous Learners 24 

G. A. Stringer, Southern Oregon University, USA; J. J. A. Smit, Potchefstroom University, South 
Africa; P. J. Enslin, Potchefstroom University, South Africa 

The Effectiveness of a Computer-Interfaced Experiment in Helping Students Understand 
Chemical Phenomenon 24 

Jerry P. Suits, McNeese State University, USA 

Teaching "Computers & Society" - The Medium and The Message 24 

Brendan Tangney, Trinity College Dublin, Ireland; Bryn Holmes, Trinity College Dublin, Ireland ; Ann 
FitzGibbon, Trinity College Dublin, Ireland 

Learning Mathematics Through Image Processing: Constructing Cylindrical 

Anamorphoses 25 

Steven Tanimoto, University of Washington, USA; James King, University of Washington, USA; 

Richard Rice, Alias/Wavefront, Inc, USA 

Critical Issues in Distance Education: Partnership, Content, and Delivery 25 

David A. Thomas, Montana State University, USA 



Teaching of Teaching of “Spreadsheets- design and use” by Learning Activity Package 25 

Daniela Touparova, "N. Rilski" South-West University , Bulgaria 

A Navigable Book To Learn Discrete Mathematics 25 

Francesc Vallverdu, Universitat Oberta de Catalunya , Catalunya; Teresa Sancho , Universitat Oberta 
de Catalunya, Catalunya 

The Effect Of Advisement & Mode Of Instruction On Transfer, Advisor Use, And Attitude 
Toward Mathematics Using A Computer-Based Simulation Game 25 

Rick Van Eck, University of Memphis, USA 

Web-Based Implementation of the Little Man Computer 26 

Joaquin Vila, Illinois State University, USA; Barbara Beccue, Illinois State University, USA 

Computer-Based Interactive Math Courses - The Guam Experience 26 

Yu-mei Wang, College of Education, University of Guam, U.S.A; Carl Swanson, College of Arts and 
Science, University of Guam, U.S, A 

Knowledge Retention Following Problem-Solving Versus Information Gathering 26 

Jeanne Weidner, University of California at Berkeley, USA; Michael Ranney, University of California 
at Berkeley, USA 

Experiences in teaching an asynchronous web-enabled course to a diverse student 26 

Chris Wild, Old Dominion University, USA 

Improving Instruction and Reducing Costs with a Web-based Learning Environment 27 

Beverly Woolf University of Massachusetts/Amherst; David Hart, University of 
Massachusetts/Amherst; Roberta Day, University of Massachusetts/ Amherst; Beatrice Botch , 

University of Massavchusetts/ Amherst; William Vining, University of Massachusetts/Amherst 

Creating microworlds for exploration of mathematical concepts 27 

Yelland Nicola, Queensland Uni of Technology, Australia 

Making Sense of Science: The University of Iowa Science Information Literacy Initiative 27 

Karen Zimmerman, University of Iowa, USA; Barbara Dewey, University of Iowa, USA 
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George Lucas, Web-based Astronomy, and Teacher Beliefs 

James C Adams, Chetek, Wl High School, USA; Dr. Robert E. Hollon, University of 

Wisconsin, Eau Claire, USA 

The Internet provides an excellent resource for students, teachers, and others to explore current 
science. In particular, it provides a vehicle for developing technology-rich courses that provide 
students with great autonomy in selecting and carrying out learning. Course development is a very 
complex endeavor linking subject matter, developmentally appropriate learning processes, available 
resources, technology, time, and assessment techniques. Less obvious, but of equal importance, is the 
interaction of teacher beliefs and design decisions. Development proceeds in a context of implicit and 
explicit beliefs about the nature of science, learning, and curriculum. Astronomy provided the context 
for illustrating the ways that one teacher's beliefs about science, learning, and curriculum were 
embedded in the development of a web-based high school course. 

ESSTEP - The Earth and Space Science Technological Education Project 

Bryan Aivazian, Wyoming Center for Problem Based Learning, USA; Ed Geary, Earth 

Science Insights, USA; Holly Devaul, The Geological Society of America, USA 

The Earth and Space Science Technological Education Project (ESSTEP) is a professional 
development program for secondary and college faculty. This program addresses the growing need to 
provide students with the critical academic and personal skills necessary for successful technical 
careers in the earth, space and environmental sciences. ESSTEP has provided educators with the skills 
to infuse global positioning system, geographic information systems and image processing into their 
classrooms. As a result of their ESSTEP experiences, educators are enhancing student learning, 
promoting science and technology careers, and catalyzing the development of new courses and 
materials. 

A Manipulative World For Learning Addition Of Numbers 

Yavuz Akpinar, Bogazici University, Istanbul, Turkey 

Technological developments provided types of tools to be employed in teaching different subject 
matters and allowed to make some problematic subjects easier. This paper critically outlines the major 
trends of the employment of computer based learning packages and argues for environments in which 
the domain tasks can be proceduralised. The design considerations of a procedural environment, 
BALANCER for learning addition, is described, implementation studies and a small informative 
evaluation on the interface are also explained. The interface facilities of the system were found 
interesting and helpful, so is interpreted promising. The paper concludes with some suggestions for 
more comprehensive evaluation studies. 

Motion Games and Thinker Tools: Using Prior Simulations to Promote Learning 

about Motion 

Thomas Andre, Iowa State University, USA; Charlotte Haselhuhn, Des Moines 

Community School District, USA; Katherine Kreiter, Iowa State University, USA; William 

Baldwin, Iowa State University, USA; Catherine Leo, Iowa State University, USA 

This presentation demonstrated computer software that helps students better understand Newton’s first 
law. Two studies of effectiveness of the software were reported. The first found that males benefited 
from use of a fanciful version of the software, but females did not. The male oriented scenario used in 
the simulation and the lower interest and prior experience of females in physics may have made more 
difficult for females to transfer the computer experience to the first law concepts taught in the chapter. 
A second study, using software that more explicitly related itself to the chapter, found that both male 
and females students profited from prior use of the simulation. They developed and demonstrated a 
better conceptual understanding of the implications of the first law. The results suggest that, contrary 
to much current practice, simulations may be more effective instructional tools if used prior to more 
direct instruction. 

Dynamic and Parameterised Animation of Computer Science Topics 

Andreas Ausserhofer, Technical University of Graz, Austria 

The purpose of this paper is to introduce an Animation Module CSAnim as extension to the S.E.A.L. 
web-based education system. The main application of CSAnim is the generation and the display of a 
dynamically processed graphical visualisation of computer-science topics based upon user-input. The 
introduction will set the focus to the problem in general whereas the problem-analysis will show, why 
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animation techniques - which have found to be a successful extension to traditional teaching methods 
- are not sufficient enough. A new approach is presented as solution to this and the integration into an 
existing education system is shown. The paper ends with future aspects and possible applications. 

Development of an Effective Multimedia/WWW Training Model for Faculty 

Patricia Backer, San Jose State University, USA; Miriam Saltmarch, San Jose State 

University, USA 

This paper describes the results of three summers of teacher training initiatives in multimedia and the 
Web for the classroom as well as a trainer of trainers model currently being undertaken for faculty at 
San Jose State University based upon the results of the summer workshops. An original objective of 
the summer workshops was directed at providing faculty who could function as trainers of other 
faculty. Moving from the year one model (training faculty to utilize a wide range of multimedia 
equipment and tools to build complete projects) to the year three model (training faculty in specific 
applications) changed the extent to which faculty could act as trainers of other faculty at their school 
sites. The current model focuses on empowering faculty to complete technology-based projects for 
their university classrooms and become trainers of other faculty in their academic units, within the 
realistic constraints imposed in a teaching-centered university. 

The Collaboratory Project's Science Fair Repository 

Richard Barone, Northwestern University, USA; Ann Blythe, Alan B. Shepard Junior High 

School, USA; Beatrise Revelins, Charles J. Caruso Junior High School, USA 

Northwestern University and Deerfield School District 109 in Illinois are collaborating on a project 
that seeks to encourage cross- district collaboration and the sharing of resources between teachers and 
students via the internet. The setting for this initiative is the annual school science fair with its broad 
scientific scope and need for community involvement. Northwestern's Collaboratory Project has 
developed an internet application that is being piloted in classes at both junior high schools in District 
109. The results thus far have been encouraging and are reported here by a member of the development 
team and the two teachers adopting this technology. 

"A Tour Before": Interpretations of a Science Gallery & the Interactive 

Videoconference Which Preceded It 

Timothy Barshinger, Purdue University, USA 

This study examined how elementary children and their classroom teacher interpreted a visit to a 
museum's science gallery and the videoconferencing link that preceded it. The interactive "virtual 
tour" was meant to serve as an advance organizer for the children. This interpretive, non-comparative 
project specifically involved four fifth grade "key informants" and their teacher. Data were gathered 
through interviews, observations, artifacts, and researcher reflections. Individual informant data was 
analyzed for common patterns and compared cross case for synthesis into key themes about the nature 
of the experiences. Data analysis revealed that the students' learning styles and peer group structure 
had an impact on the nature of their investigations during the on-site visit. Also noted was how the 
videoconference was a successful advance organizer. Students were able to create mental organizers, 
such as mental maps and interest agendas, following the link which helped direct and focus their 
exploration during the museum visit. 

Gaining confidence in mathematics: Instructional technology for girls 

Carole Beal, University of Massachusetts, USA; Beverly Woolf, University of 

Massachusetts, USA; Joseph Beck, University of Massachusetts, USA; Ivon Arroyo, 

University of Massachusetts, USA; Klaus Schultz, University of Massachusetts, USA; 

David Hart, University of Massachusetts, USA 

AnimalWatch is a matehmatics tutor with enhanced adaptive feedback precisely tailored to girls' 
instructional needs. Three evaluation studies with fifth grade students support our hypothesis that 
adaptive feedback is beneficial to girls' math confidence. We have also had high levels of teacher 
participation including classroom activities, after-school presentations and summer workshops. This 
paper describes features of the tutor, evaluation studies, work with classroom teachers and 
dissemination activities. 
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Communication between problem solving groups in an On-line Geometry course: 
results and lessons learned 

Brian Beaudrie, Northern Arizona University, USA; David A. Thomas, Montana State 
University, USA 

The purpose of this study was to investigate the relationship between communication and achievement 
among cooperative learning groups performing problem-solving activities in a WWW-based Geometry 
for Teachers distance education course. This paper presents an overview of the preliminary findings of 
the study. 

Partners in Science - Collaboration, Mewntorships, and Technology 

Gary Bender, Office of Instructional Technology, Fairbanks North Star Borough School 
District, Fairbanks, Alaska, USA 

This paper is a preliminary report discussing initial results of the five year Partners in Science project. 
Partners in Science is a project linking K-12 students and teachers with practicing university, industry 
and agency scientists using networked technology, with the aim of increasing the practice of authentic, 
project-based math and science. The project’s goals are to: 1) Improve the student’s understanding of 
science by designing and conducting their own research; 2) Effectively utilize technology as a part of 
the learning and teaching of science and mathematics; 3) Bring active scientists into the teaching and 
learning process, both in and out of the classroom. Research data gathered from teachers, students, and 
scientists indicates that the project shows promise in each of the three areas. 

Strategies For Developing a Precalculus Course With Web Based Activities 

Jean Bevis, Georgia State University, USA; Margo Alexander, Georgia State University, 
USA; Draga Vidakovic, Georgia State University, USA 

In the precalculus course under development, students have the option of accessing interactive web 
based materials in lieu of attending lectures. They also have the option of taking daily quizzes in class 
or over the web. When students complete their daily work, it keeps them involved in the course 
material in a regular and beneficial manner. When students do not complete their daily work, the easy 
accessibility of options, helps students to accept responsibility for their decisions. We also report on a 
successful strategy for the rapid development of this Web-based course. 

Some Psychological Aspects Of Using Information Technologies In Teaching 
Linear Algebra. 

Mikhail Bouniaev, Southern Utah University, USA 

Despite the indisputable advantages of using information technologies in teaching mathematics in 
general and linear algebra in particular certain problems related to technology-oriented education 
have become quite evident now. The presentation reviews and analyses efficiency and expediency of 
using information technologies at different stages of teaching linear algebra. Our research is based on 
the results of the experiment conducted during the last five years in teaching linear algebra with 
MATLAB and modem calculators. This paper is a follow up of an earlier article “Linear Algebra With 
MATLAB Package In Preservice Teacher Education” (Bouniaev, 1997). 

A Modularized Competency-Based Science / Math Curriculum for Associate 
Degrees in Information Technology 

Douglas Brown, Northwest Center for Emerging Technologies / Bellevue Community 
College, USA; Arthur Goss, Bellevue Community College, USA 

This session will present the Science & Math for Information Technology (SMIT) core curriculum 
developed through the NorthWest Center for Emerging Technologies at Bellevue Community College 
(Washington) and a selection of representative hands-on activities. Designed to provide an efficient 
and flexible tool for strengthening the analytical component of IT programs by infusing appropriate 
science and math learning experiences, it has several distinguishing features: Competency-based and 
linked to the nationally recognized, industry-based NWCET IT Skill Standards, Individual units can be 
incorporated into existing IT courses or combined into stand-alone courses, Curricular goal is not 
topical coverage but for students to "learn how to learn science" and acquire a foundation for broadly 
applicable science/math-based analytical techniques, and Organized around team projects with a real 
world structure and format. They are inquiry-based but require a concrete deliverable outcome. 



Visual Venture: Investigations with Images and Videos 

Lisa M. Brown, IBM TJ Watson Research Center, US; Susan Crayne, IBM TJ Watson 
Research Center, US 

In this paper, we describe an educational software tool, which allows students to take measurements on 
images and videos. Students become scientists as they measure, collect and analyze data from a wide 
range of imagery. We will describe two major emphases of this work. First of all, as a corollary to 
scientific image processing software, this program was fundamentally designed as a general, open- 
ended tool for investigation. Students have the opportunity to learn the scientific process first hand. We 
discuss the relationship of this software to scientific tools, the potential for true inquiry-based learning, 
and the associated issues and problems that occurred in bringing this to the classroom. Our second 
emphasis in this work was to create a tool, which could be used for curriculum development and 
interdisciplinary learning. The software exploits the recent availability to students and teachers of an 
extraordinary plethora of scientific images and videos. This allows content to correspond closely to a 
specific curriculum, to pertinent events and to student and teacher interest. We detail several ways that 
curriculum specialists and teachers can take advantage of the wealth of imagery that is currently 
accessible. Lastly, we briefly describe the evolution of the software and the feedback we have received 
from students, teachers, and curriculum/technology specialists. 

Teachers Implementing GIS in 5th-12th Grade Classrooms: An Investigation of the 
Necessary Staff Development Experiences and Support 

Alan Buss, University of Wyoming, USA; Patricia McClurg, University of Wyoming, USA 

This paper reports the results of a two year study investigating the types of experiences and support 
necessary for in-service teachers to effectively integrate Geographic Information Systems (GIS) in 
their teaching/leaming environments. Questions guiding the investigation included 1) can GIS be a 
useful tool in the classroom and 2) will teachers’ participation in an extensive in-service affect their 
level of confidence in their ability to use GIS and/or their attitudes toward GIS as an effective tool in 
the classroom. Assessment measures included (1) contrasting the level and type of teacher use based 
on classroom observations, interviews, participation in web-based discussions, and lesson plan 
analyses; and, (2) teacher self-ratings on a 14-item Likert confidence and attitude instrument. The large 
majority of participants did plan and implement GIS lessons in meaningful contexts. Statistically 
significant gains were detected (p<. 001) for each of the fourteen items on the teacher survey. 
Computer Assisted Synthesis of Visual and Symbolic Meaning in Mathematics 
Education 

Stephen Campbell, University of California, Irvine, U.S.A. 

A number of factors pertaining to a wide variety of distinctions — such as particular-general, 
arithmetic-geometry, sense-reference, procedural-declarative, concrete-abstract, object-attribute -- are 
implicated in developing a meaningful understanding of visual and symbolic aspects of mathematics. 
A rather simplistic "association-abstraction" model of mathematical cognition, as it stands, appears 
inadequate to account for these factors, particularly with respect to instructional design and 
assessment. Such fundamental inadequacies warrant better theory and more research. Methodology 
directed to this end, drawing on digital video technology, is sketched out. 

Digital Photography for Math and Science 

Catherine Cavanaugh, Ph.D., University of South Florida, USA; Terence Cavanaugh, 
Ph.D., University of South Florida, USA 

Digital cameras have many advantages over film cameras for math and science education, and add a 
multimedia dimension to learning. Today’s digital cameras offer a variety of features, and are as easy 
to use as film cameras without the expense of film processing. Digital images are available more 
rapidly than film images, allow unlimited low-cost duplication, and can be controlled and manipulated 
easily. Using a digital camera, students make personal meaning of documents, presentations, and 
electronic communications such as email and web pages. Math and science teaching and assessment 
are enhanced through electronic field trips, demonstrations and portfolios. Digital cameras enable 
students to visualize the mathematical and natural worlds in unique ways. Many cameras have 
panorama and limited audio/video capabilities. Most offer live or recorded video output, and can be 
used with special lenses, including microscopes and telescopes. 



Interactivity in Mathematics and Science Education 

Ozlem Cezikturk, State University of NewYork at Albany, USA; Murat Kahveci, Florida 

State University, USA; Gulcin Cirik, San Diego State University, USA 

Today, interactivity is seen as a key factor for achieving effective learning environments. Research 
says that "Interactivity" is a messy idea that takes its meaning from a system of metaphysical 
oppositions. These oppositions range from learner control issue to the debate. A group of academicians 
and researchers were asked to imagine a "Richly Interactive Learning Environment" to the fullest 
degree possible. The commonalities and differences in their ideas are investigated in order to come up 
with a shared understanding of interactivity for the new millennium. The aim of this article, is to both 
deconstruct and reconstruct a theory for interactivity with some real ground from previous research, 
ideas from that group, and from the ideas of the authors, as a whole. With this framework in hand, we 
hope that it will be possible to differentiate the real promises of "interactivity" from the wonderland 
promises. 

The Teacher's Attention Empowering Children's Math Learning With Computers 

Ni Chang, University of Wisconsin-Whitewater, USA 

This paper reports the findings of a study, a pilot study, conducted in a childcare center in Whitewater, 
WI. Eight children were involved and divided into two groups: control and experimental groups. 
Quantitative and qualitative methodologies were used to analyze the data collected from pre- and post 
tests and interactions of a child with a computer. Findings show that children who are observed and 
helped by a teacher gain mathematical concepts faster and more efficient than those who are 
completely left alone at the computer. This pilot study implies that the teacher needs to pay attention to 
children at computers while working with or supervising children doing other activities. An extended 
study is suggested to replicate the findings of this pilot study. 

Math at Midnight: Teaching and Learning Implications 

Faith Chao, Golden Gate University, US; Jim Davis, Golden Gate University, US; Peg 

McPartland, Golden Gate University, US; TJ Tabara, Golden Gate University, US 

In this presentation we will discuss some of our course explorations that utilize the asynchronous 
features of the Internet together with its graphic capabilities to build web-based math courses at 
Golden Gate University. We will focus on the internet technology that gives students the flexibility to 
participate in classes at any time of the day and any day of the week and how this flexibility affects 
their expectations of the course. We will also discuss course design features and teaching strategies in 
order to motivate students to achieve understanding at a deep level for the varied learning styles of this 
new medium. The techniques utilized in a variety of math courses will be discussed along with student 
comments and our findings of learning outcomes. 

Using Maple V (Graphics and Programming) for Calculus Teaching 

Mingxiang Chen, Department of Mathematics, North Carolina Agricultural and Technical 

State University, Greensboro, NC 27411, U.S.A. 

Maple V is an elaborate Computer Algebra Systems (CAS). We use Maple as a tool in teaching 
Calculus. We give students brief tutorial on Maple commands and syntax. We use Maple to plot graphs 
of library functions and user-defined functions, of one variable and two variables, implicit functions, 
and parametric equations. This part of activities helps students become familiar with curves and 
surfaces in two-dimensional and three-dimensional spaces, and with polar, cylindrical and spherical 
coordinate systems. We use Maple programming language to write procedures such as Trapezoidal 
Approximation and Simpson's Rule in numerical integrations. We combine programming and plotting 
to demonstrate intrinsic points such as relationship between a function's monotone and convex 
properties and the sign of its derivatives, graphs of a function and its inverse function, Taylor 
Approximations, and dynamics of a family of functions with parameters. 

Progressive Comparison of the Effectivness of Computer-Assisted Instruction on 

Science Achievement: A Meta-Analysis 

Edwin P. Christmann & John L. Badgett, Slippery Rock University, USA 

This study compared science students who were exposed to traditional methodology with those who 
received traditional methodology supplemented with computer- assisted instruction (CAI). From the 24 
conclusions, an overall mean effect size of 0.266 was calculated, indicating that, on the average, 
students receiving traditional instruction supplemented with CAI attained higher academic 
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achievement than did 60.4% of those receiving only traditional instruction. The effect sizes were 
categorized into four subject areas. In descending order, the mean effect sizes in general science, 
physics, chemistry, and biology are: 0.707, 0.280, 0.085, and 0.042, respectively. Differences in 
educational settings revealed that CAI is most effective among science students in urban areas; 
followed by those in suburban areas; and weakest among rural students. However, a -0.335 correlation 
between effect size and years indicates that the effect of CAI on academic achievement has declined 
during this period. Some of the findings were reported in Christmann and Badgett (1999). 

Enhancing Science Field Trips with a Digital Camera 

Kenneth Clark, Georgia Southern University, USA; Alice Hosticka, Georgia Southern 
University, USA 

Digital cameras in the science classroom can be used as a tool to enhance field trips. Field trips are 
meant to provide students with important hands-on experiences to further the goals and objectives of 
the curriculum. Many times they turn into no more than a day away from school. These trips can add 
value to the curriculum by providing pre-trip preparation, structured experiences on the trip, and 
experiences taken back to the classroom from the trip. The digital camera can be used to develop 
materials to use in preparation for the trip and record aspects of the trip to bring back to the classroom 
for further study. Although film based technologies can provide the same opportunities, the use of the 
digital camera provides a hassle-free way to capture, manipulate, and present images relative to the 
instruction. 

Realism and Credibility in a Simulation-Based Learning Environment: the Virtual 
Physics Laboratory (VPLab) 

Marc Couture, Tele-universite, Canada; Alexandre Francis, Universite de Montreal, 
Canada 

Realism and effectiveness of computer simulation-based learning or training environments have been 
examined in several studies. It was shown that under certain conditions, simulations can be as efficient 
as real experiments, and that increased realism may result in gains in 'practical appreciation'. However, 
few have investigated the relationship between realism and credibility, or between credibility and 
effectiveness. The VPLab is a simulation-based learning environment featuring many characteristics 
and constraints normally associated with real experiments. These include uncertainty in measurement, 
random fluctuation of parameters, and limitations in user control over the simulation. We believe that 
our approach, which distinguishes the VPLab from most existing simulation-based laboratories, greatly 
increases its credibility. It also makes possible the teaching of laboratory skills not usually associated 
with simulation. 

RiverWatch Project: The Confluence of Science and Technology 

Gregory A. Coverdale, Penn State Harrisburg, USA 

National standards in science education argue that science learning should be interdisciplinary, 
inquiry-based, and involve students in real-world projects. Most rhetoric in science education also 
argues for technology integration in science instruction. This paper describes the RiverWatch project, 
which integrates science and technology, and models scientific collaboration between 5th grade 
students in Indiana and preservice teachers at the Pennsylvania State University in Harrisburg. 

Effects on Attitudes Toward Computer Programming of Using Java Versus C++ to 
Teach Introductory Programming to Non-Computer Science Majors 

Fred Croop, College Misericordia, USA 

Several non-Computer Science disciplines may require students to take computer programming 
courses. Examples include Information Systems, Educational Technology, Engineering, and Business 
Management. These curricula typically are designed to provide the enrollees with exposure to the 
application of computer programming, development of problem-solving skills, and possibly the 
background in a language that can be used for further study in research, analysis, or data structure 
design. Some non-Computer Science majors fear, and/or do poorly in programming. Other students 
find programming interesting and non-threatening. For all students there is a possibility that their 
attitudes toward computer programming will change during and as a result of their introductory 
course(s) in the subject. Two languages used to teach object-oriented programming are Java and C++. 
This poster demonstration summaries self-expressed attitudes toward computer programming of a 
small group of students who have studied both Java and C++. 
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Animations in Physics Learning 

Patric Dahlqvist, Stockholm University/KTH, Sweden. 

The study reported on in this paper investigates the effects of different presentation formats on learning 
an important principle in classical mechanics (the principle of equivalence). The presentation formats 
were abstract (classical vector representation), analogue (a more experience based illustration) and 
animated analogue. The study was conducted (N = 55) at the department of physics, Stockholm 
University. Analyses indicate that animations do not facilitate learning in this case. An interesting 
observation is that the analogue and animated groups performed better than the abstract group on the 
analogue problems. But the abstract group did not outperform the other groups on the abstract 
problems. A tentative interpretation is that it is easier to move from an analogue representation to an 
abstract than vice versa. Another interpretation is that it may be the case that the students in the 
concrete conditions expended more effort into applying an abstract thinking on their concrete memory 
image. 

Investigating Families of Quartic Polynomials via a Computer Algebra System 

Tilak de Alwis, Southeastern Louisiana University, USA 

Consider the one parameter family of quartic polynomials given by f(x)=(x-a)(x-t) A 2*(x-b) where a 
and b are distinct real constants, and t is a real parameter. Let A(a,0), B(b,0) and C(t,0) be its x- 
intercepts, and D(0,abt A 2) be its y-intercept. Suppose that the normal lines to the graph of f at the 
points A and B meet at R, and the tangent lines to the graph at those points meet at S. As the 
parameter t changes, the graph of f changes. However, the points A and B remain fixed while all 
other points C, D, R and S change. This paper discusses some geometric properties such as 
centroids, circumcenters, orthocenters, and locus problems of the variable triangles ABR, ABS etc. 

Geometric Skills: Hands-on Manipulatives to the Logo Turtle's Path 

Estella De Los Santos, University of Houston-Victoria, USA; Barba Patton, University of 
Houston-Victoria, USA 

There is much evidence to support the fact that manipulatives create a visual representation as well as 
provide a tactile (hands-on) approach to many geometric situations. De Los Santos and Patton believe 
that while computers create a visual representation, the tactile (hands-on) approach is missing. They 
conjecture that, in order for children to be the most successful, tactile (hands-on) activities using 
manipulatives must be included in the lessons and precede any LOGO activities. The study in progress 
follows a post-test only experimental design. The control group receives LOGO instruction while the 
experimental group receives instruction using manipulatives prior to the LOGO instruction. The post- 
test will measure the ability to construct interior and exterior angles and given polygons. 

An Authoring Tool for Hint Generation. 

Rachel DiPaolo, The University of Memphis, USA; Holly White, The University of 
Memphis, USA; Arthur Graesser, The University of Memphis, USA 

Hinting is important during the learning process, because it facilitates the active construction of 
knowledge. Constructive activities lead the student to an integrated and prolonged involvement with 
the material. Hints encourage the student to generate information and enhance memory for the learned 
information. Hinting increases student control during the learning process. We propose an authoring 
tool for hint generation that is based on conceptual graph structures. Conceptual graph structures have 
been used in the study of text comprehension (Graesser & Clark, 1985). These knowledge structures 
are made up of different types of nodes, which are interconnected by different types of arcs. Our hint 
generation model makes use of the information embodied in the relationship between the arcs and the 
nodes of these structures. This model is currently being implemented in computer based tutoring and 
has potential applications in related areas, such as web-based training. 

Mathematics Standards 2000 and the Virtual Environment 

Jim Dorward, Utah State University, USA; Robert Heal, Utah State University, USA 

This paper describes the rationale for the forthcoming Principles and Standards for School 
Mathematics and accompanying electronic pedagogical examples. Many of these electronic examples 
are part of a web-based national library of virtual tools and manipulatives being developed at Utah 
State University with support from the National Science Foundation. Also included is a review of 
research on the use of computer-based manipulatives, description of applet design considerations and 
characteristics, and a discussion of research implications. 



Teaching Computer Programming Languages Through WWW 

Mahmoud El-Khouly, Saitama University, Japan; Behrouz Far, Saitama University, 
Japan; Zenya Koono, Saitama University, Japan 

This paper presents web-based tutoring system (W-TCL) for teaching computer programming 
languages through WWW. In this version, two new features have been added; blackboard module and 
adaptive interface. With blackboard module a teacher can exchange his expertise with other teachers, 
and with adaptive interface the novice student will be satisfied because the system avoids complex 
interfaces. The system contains three sub-agents: the personal assistant agent for teacher (PAA-T), the 
personal assistant agent for student (PAA-S) and tutoring agent (TA). Using PAA-T, many teachers 
can cooperate together to: (a) put the curriculum of one/more computer programming language(s), (b) 
add or modify the commands' structure that will be taught, (c) generate different tutoring dialogs for 
the same command, and (d) generate different tutoring styles (e.g. text or Q&A). 

College Science via Internet: How effective is it? 

Kathleen Flickinger, Maui Community College, US; Contance Hargrave, Iowa State 
University, US 

In this paper college science instruction via the Internet is examined from three perspectives: students' 
on-line learning experiences; a comparative examination of learning on-line versus traditional 
instruction; and instructors' experiences teaching on-line. The setting was a freshman-level human 
anatomy / physiology course. Three students participated in a collective case study to describe the 
learning environment created by the Internet course. Motivation, computer savvy, and self-confidence 
were important to their success. A quantitative study of the on-line course and the traditional course 
evaluated the comparative effectiveness of the learning environments. Achievement scores and survey 
results indicated content understanding and retention were not effected, while desirable student study 
habits were used more frequently in the Internet section. To better understand the instructional 
implications of on-line courses, a case study was conducted. Internet instructor's time commitment and 
level of teaching satisfaction were high. The instructor’s role changed, causing some lessening of job 
satisfaction. 

Computer Visualization in the Mathematics Classroom 

Erzsebet Forczek, Albert Szent-Gyorgyi Medical University, Hungary; Janos Karsai, 
Albert Szent-Gyorgyi Medical University, Hungary 

This paper reviews of the education in mathematics at the University of Szeged. Mathematics is a 
fundamental course for Pharmacy students. The main topics are basic concepts and properties of 
functions of one or several variables, limit, derivative and ID differential equations. All the topics are 
illustrated with practical examples. The abstract concepts are somewhat difficult for the student to 
understand consequently, we emphasize the geometrical meaning and this is the point where we apply 
computers, so visual images are important aids in making matematics understood, because 
visualization is essential for understanding. The 3D scenes, the animation and the possibility of 
students interactivity are real advantages of the computer. 

Issues in the Preparation of Prospective Elementary School Teachers to use the 
Internet in the Teaching of Mathematics 

Jane Friedman, University of San Diego, USA 

The Internet, particularly, the World Wide Web, has had a substantial impact on society. Whether or 
not these technologies will be able to effect beneficial change in K-12 education is another question. 
In the past educational reforms have often foundered due to a lack of teacher preparedness and on- 
going teacher support. This paper will discuss the experience and attitudes of a group of pre-service 
elementary school teachers enrolled in a required content mathematics course. 

Development of Distance Education Technology on the Example of Course 
"Artificial Intelligence" 

Tatiana Gavrilova, St.Petersburg State Technical University, Russia; Sergey Udaltsov, 
Institute for High Perfprmance Computing and Databases, Russia; Natalie Stash, 
St.Petersburg State Electrotechnical University, Russia 

The paper presents the way of organizing distance learning course on the sample of discipline 
"Artificial intelligence". Peculiarity of the project is in adaptive character of education, i.e. in 
possibility of distance learning system implemented for development courseware to be arranged under 
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individual features of the concrete user. The aim of the system is to define the best program of 
education for him by adapting scenario of the learning material and to help in the process of 
navigation. Adaptability is especially important for educational applications on World Wide Web 
which are expected to be used by very different groups of users without assistance of a human teacher. 

Conceptual Learning of Physics - Science 

Ivan Gerlic, University of Maribor, Slovenia 

One of the main objectives of physics is to lead students to an undestanding of basic concepts which 
can serve as basis for an explanation or prediction of natural and technical processes. Mathematical 
methods play a decisive role while pursuing this goal since an explanation or prediction is only reliable 
if the underlying law can be formulated in mathematical terms. Therefore mathematics is an essential 
part of physics teaching; however, it causes at the same time severe learning difficulties, well-known 
and especially important for physics teaching. To understand an unknown piece of knowledge, the use 
of an abstract tool has first to be acquired and then this tool has to be applied to the yet unknown part 
of reality. With modem computers and their advanced possibilities to animated graphics it is now 
possible to model and visualise a major part of classical physics by using rather simple numerical 
methods. All needed calculations can be left to the computer. Only after a qualitative understanding 
has been reached, the advantage of abstract mathematical methods can be demonstrated and 
corresponding learning goals can be acquired. 

Constructing Physics Understanding: Simulation Software for Exploring Physics 

Fred Goldberg, San Diego State University, USA 

The Constructing Physics Understanding Project is a National Science Foundation supported project 
(Grant No. ESI-9454341) aimed at creating laboratory and computer-based materials to support a 
learning environment where students take primary responsibility for developing valid and robust 
knowledge in physics. As part of this project we have developed 20 pedagogically-oriented computer 
simulations, covering several topical areas in physics: light and color, static electricity and magnetism, 
force and motion, current electricity, waves and sound, and the small particle model of matter. The 
simulations are written as Java applets to run under Internet Explorer on individual computers (not 
over the Web). Students use the simulators to explore phenomena, both qualitatively and 
quantitatively, and they can receive both phenomenological and model-based feedback. The 
simulations can be used to complement all types of physics courses, but were especially designed to be 
integrated into the CPU curriculum, where they are used to complement and extend hands-on 
laboratory activities. 

The Constructing Physics Understanding Project: Integrating computer 
simulators, hands-on experiments and group discussions to promote meaningful 
learning in physics 

Fred Goldberg, San Diego State University, USA; Valerie Otero, San Diego State 
University, USA; Andy Johnson, Black Hills State University, USA 

The Constructing Physics Understanding Project is a National Science Foundation supported project 
(Grant No. ESI-9454341) aimed at creating laboratory and computer-based materials to support a 
learning environment where students take primary responsibility for developing valid and robust 
knowledge in physics. The CPU project has developed a student- centered pedagogy, carefully 
sequenced sets of activities in several different topical areas of physical science, and a set of 
pedagogically-designed computer simulators. Rather than depending on the instructor as the source of 
knowledge, in the CPU classroom students develop, test and modify their own ideas through 
experimentation and discussion with their peers. The materials have been used successfully with 
secondary school physics and physical science students, and with prospective and practicing 
elementary teachers (through workshops and University courses). 

Virtual-Real Lab: an electronics laboratory using real devices and the internet 

Humberto Gomes, UFRGS, Brazil; Rita Machado, UFRGS, Brazil; Luigi Carro, UFRGS, 
Brazil 

This paper presents the design and utilization of an Electronics Laboratory, physically available 
through the Internet. One of the greatest advantages of this project is to offer to many students the 
possibility of achieving practical experiments in the electronics field without the need of their presence 
in the laboratory room. This paper shows the hardware used to develop the system and the ffontend 
web page with the required security involved. 




The Influence of Instructional Video materials on Student Acquisition of Biological 
Concepts 

Moses Gostev, Teachers College of Columbia University, USA; O. Roger Anderson, 
Teachers College of Columbia University, USA 

Students' cognitive preferences in using scientific information were analyzed using a paper and pencil 
inventory. We found strong and weak cognitive components. Strong components ("questioning- 
preference") predicted higher academic performance (p = 0.03, d.f.=19) compared to the remaining 
"weaker" components (more knowledge-based), which were not readily discriminable from one 
another. Moreover, "questioning"-type students, compared to the "weaker"- component group, 
achieved better test scores on higher-level cognitive skills (e.g., application and analysis) (p < 0.02, 
d.f.= 18), but not with basic knowledge, indicating their greater capacity with increasing cognitive 
demands in learning. Furthermore, use of a video that served as a theme or guiding framework for 
instruction significantly increased achievement compared to a control group taught in a more 
conventional way (p = 0.04, d.f.=16). These results suggest that use of thematic-centered video 
segments, and due attention to strengthening higher order cognitive preferences, in other instructional 
settings such as computer-based learning may enhance achievement. 

Influence of Graphing Software (Mathematics, Wolfram) in Conjunction with the 
Interactive White Board on the Students' Learning of Exponential Functions in a 
High School. 

Livia Gouriliova de Vargas, New Horizons Bilingual School, Dominican Republic 

This paper describes a work- in -progress project that examines the effects of the graphing software and 
interactive white board used as an audiovisual mean to display graphs on students’ learning of 
exponential functions, as well as the nature of the content that we teach, and changes of teaching 
techniques. Through group work in the computer laboratory, students analyzed, discussed, and made 
generalizations about properties of exponential functions. The teacher’s role was facilitating students’ 
interaction, helping them with basic syntax and techniques, and monitoring students’ discussions in 
order to reach conclusions correctly. Even if students’ showed positive attitudes toward mathematics 
and rated their class as more interesting, some questions (for example, why some students rely too 
much on their graphing utility and do not see errors in their graphs produced because of improper use 
of a software syntax) were raised later. Therefore, it is important to find concrete answers in further 
work. 

Education and the Internet Opportunity 

Jennifer Degnan, SmarterKids.com , USA; Beth Standring, SmarterKids.com, USA; 

SmarterKids.com, is the number one educational store on the Internet that is dedicated to providing 
quality services and products to help parents instill a love of learning in their children. 
Smarterkids.com is unique for several reasons including the site’s assessment and personalization 
options. Our Learning Style Survey allows parents and teachers to quickly and easily assess how a 
child learns best and find appropriate educational tools best suited to that child’s individual style. Our 
MySmarterKids feature enables parents to develop distinct learning profiles for a child to ensure 
personalized product recommendations based on the child’s individual learning needs, goals, and 
styles. Additionally, partnerships with Lightspan.com and National Computer Systems Inc. allow us to 
better bridge the gap between home and school. Together, we combine award-winning content and up 
to date statewide standards and assessment information with a unique educational shopping 
experience. 

Mathematical Modeling within a Technology Based Learning Environment: Some 
Principles for Adaptive Instruction 

Neal Grandgenett, University of Nebraska at Omaha, U.S.; Elliott Ostler, University of 
Nebraska at Omaha, U.S.; Art Zygielbaum, University of Nebraska at Lincoln, U.S.; Scott 
Henninger, University of Nebraska at Lincoln, U.S.; Char Hazzard, University of 
Nebraska at Lincoln, U.S. 

This paper describes a set of research based instructional plans being developed by a multidisciplinary 
team of researchers at the University of Nebraska within a National Science Foundation Proof-of- 
Concept Grant. The project is seeking to establish a prototype effort for teaching mathematical 
modeling within a technology based learning environment, which includes components of adaptive 




instruction for the student Seven curriculum based design principles for the adaptive instruction that 
are being followed in the development of the project are described in the paper as they relate to 
research on effective mathematics instruction, and in particular the enhancement of mathematical 
modeling activities. 

Can the same results be obtained using computer-mediated tests as for paper- 
based tests for National Curriculum assessment? 

Lillian Greenwood, The Queen's University of Belfast, Northern Ireland; Fred McBride, 
The Queen's University of Belfast, Nl; Hugh Morrison, The Queen's University of Belfast, 
Nl; Palama Cowan, The Queen's University of Belfast, Nl; Maria Lee, The Queen's 
University of Belfast, Nl 

This paper describes part of a research programme designed to explore the validity of using computer 
mediated tests as opposed to paper-based ones for National Curriculum testing in mathematics at Key 
stage 3. Previous research in this area has focused primarily on the comparison between computer- 
based and paper-based multiple choice questions while this research uses constructed response 
questions similar to those used at present in National Curriculum testing. A total of 127 pupils was 
tested using questions based on items selected from National tests in mathematics at Key stage 3. The 
study showed that where questions tested similar cognitive tasks there were no significant differences 
in outcomes. Questions requiring spatial awareness were more difficult when presented in a computer 
environment. Also the study illustrated that constant care is required to ensure that computer-based 
questions do not change the level of cognitive tasks of paper-based examples. The paper demonstrates 
the potential and limitations of a shift to computer based assessment. 

Evidence of College Students’ Graphic Decoding Gaps During Use of a Computer 
Simulation of Photosynthesis 

Phyllis Baudoin Griffard, University of Houston-Downtown, USA; James H. Wandersee, 
Louisiana State University, USA 

Twelve college science majors enrolled in introductory biology participated in two in-depth clinical 
interviews in which they verbalized while working with an award-winning computer simulation of a 
complex biochemical process, photosynthesis (Logal Corporation 1994). Their verbalizations during 
this and other cognitive tasks led to the identification and categorization of gaps that exist in their 
conceptual frameworks. Gaps fell into two major categories: propositional gaps and processing gaps. 
The graphic decoding gaps discussed in this paper comprise one category of the processing gaps. 
Graphic decoding gaps included gaps in icon-decoding and gaps in graphic literacy skills. Icons in the 
simulation for sugar output, photorespiration, oxygen production rate, flow lines, Calvin cycle and the 
radiolabel button were erroneously decoded. Gaps in participants' graphic literacy skills included 
design convention gaps, orientation gaps, and representation gaps. 

STeam- Designing a Framework for New Forms of Cooperation in Education 

Thorsten Hampel, University of Paderbom, Germany 

The explosion-like distribution of worldwide data networks has changed and formed our life with 
lasting results. Surely the education sector at our universities and schools is substantially affected by 
this development. Unfortunately the development and distribution of cooperation supporting systems, 
i.e. tools that are not only like the WWW geared to the passive consumption of information, is still in 
its infancy. Following, the research project STeam (structuring information in a team) of the Heinz 
Nixdorf Institut deals with the conception and development of new learning scenarios and 
infrastructures which are adapted to the advanced "interactive” level of the WWW, enabling the user to 
explore and design their learning materials cooperatively. 

Making Movies on the Web Accessible to People With Disabilities 

Eric G. Hansen, Educational Testing Service, USA; Douglas C. Forer, Educational 
Testing Service, USA; Louis S. Mang, Educational Testing Service, USA 

This paper describes basic requirements for making movies on the Web accessible for people with 
disabilities. The paper focuses on important alternative content that needs to be added to movies, such 
as captions, auditory descriptions, and collated text transcripts. It also describes a prototype system for 
delivering movie-using test questions accessibly over the Web. Resources for going beyond the basics 
are then presented. 



Real education from virtual objects: active learning in science on-line 

Roy Hawkey, The Natural History Museum, UK 

This paper describes, analyses and evaluates an on-line science education project - QUEST - that was 
designed to develop a constructivist approach to learning by enabling students to carry out a series of 
investigations on a range of natural objects, by applying virtual tools, and to share their findings. It 
examines the project and explores the effectiveness of such an approach to learning science on-line, 
which is focused on the search for solutions rather than on the solutions themselves. Particular 
emphasis is given to issues relating to interactivity, the representation of scientific methodology and 
the role of names in the natural world. 

Demos with Positive Impact: A resource for mathematics instructors 

David R. Hill, Temple University, USA; Lila F. Roberts, Georgia Southern University, 

USA 

In any form of instruction the instructor plays an important role as facilitator of learning. 
Demonstrations to accompany ideas and concepts are a requirement for effective instruction. 
Experienced instructors have private toolboxes of demos, conceptual approaches, or physical gadgets 
they use to encourage students to tune-in to mathematics. This rich, but largely unharvested source of 
tried-and-tested ideas forms the basis for Demos with Positive Impact, a project that will develop a 
web-based database of instructional demos and connect this resource to university mathematics 
instructors. This project takes advantage of the knowledge and experience of colleagues across the 
country and presents these valuable resources to the mathematics community in an attractive, user- 
friendly format. Demos with Positive Impact is a resource for instructors who are looking for ideas or 
demonstrations adaptable for various teaching styles and learning environments. 

Synergy Education Press: Tools for Teachers' Professional Development 

Jeffrey Horvath, Synergy Education Press, Inc., USA; Richard Lehrer, University of 

Wisconsin-Madison, USA; Matthew Koehler, Michigan State University, USA; Anthony 

Petrosino, University of Texas-Austin, USA 

Synergy Education Press, Inc. is developing a series of Internet-based, video-intensive, case-based 
teacher professional development products for elementary math and science educators. New teaching 
and learning standards, the need to ground teacher professional development in practice, and recent 
technological advances allow us to create these cutting-edge products. Our product design is based on 
over a decade of research on children’s thinking, teacher practices, and educational technology. Our 
design has been extensively tested and shown to significantly improve teachers’ understanding of key 
ideas about math and teaching as well as their ability to integrate those ideas and apply them in the 
classroom. Also, our entire product line will be firmly grounded in the practice of actual classrooms. 
Finally, our entire product line will be consistent with national standards for math and science 
education. 

Hypermodels: Embedding Curriculum and Assessment in Computer-Based 

Manipulatives 

Paul Horwitz, The Concord Consortium, USA 

This talk will demonstrate "BioLogica," a new kind of educational technology which combines an 
open-ended, manipulable model of biology with a multimedia module. A scriptable control engine sets 
up a series of challenges for students, and monitors their actions. In this way, curriculum and 
assessment activities can be embedded in the software. BioLogica scripts are written in a simplified 
version of Java. Their creation requires a degree of familiarity with programming, but we plan to 
enable non-programmers to customize them. 

Changing the Rules: Children, Creativity and Computer Games 

Celia Hoyles, Institute of Education, University of London, UK; Richard Noss, Institute of 

Education, University of London, UK 

Computer games are important in children’s culture. They afford opportunities for fantasy, challenge, 
collaboration and competition, all essential elements of play and learning. Yet their relationship with 
learning remains tenuous. This paper will present some work that seeks to build computational 
‘playgrounds’ where children will learn about rules, by designing, building and playing their own 
computer games. 



Development of Multimedia Learning Modules in Chemistry Using Authorware 5.0 

Christie Jester, University of Texas at Austin, USA; Joanne Williams, University of Texas 

at Austin, USA 

Valence Shell Electron Pair Repulsion and Valence Bond Theories pose great difficulties for chemistry 
students. Using Authorware, we developed a user-friendly computer tutorial with multiple interactions 
and animations, an interactive glossary, periodic table, and practice problems and quizzes with 
personalized feedback. Students will use hyperlinks to move throughout the tutorial at their own pace, 
will be able to revisit sections of interest for extra help, and look up key words in the glossary. Three- 
dimensional molecular models and movie clips help students visualize molecular structure and 
hybridized orbitals. To encourage active participation and practice, students will be given short 
segments of text accompanied by a graphic, followed by several practice problems. End-of-chapter 
review questions will be similar in scope and form to those that students encounter on course exams. 

Web-Based Writing and Peer Reviewing in Chemistry Education 

Christie Jester, University of Texas at Austin, USA 

Research has been done showing the usefulness of writing in learning academic subject material. In 
college programs, numerous techniques, such as summary writing and peer reviewing have been 
adopted. In the sciences, however, large class sizes often preclude students from having frequent 
writing opportunities. We solved this problem by creating a semi-automated web-based peer-editing 
program. Our goals were to help students learn chemistry concepts by writing about them and to 
prepare students for future careers by developing their writing skills. A peer-reviewing process and 
assessment rubric was devised to allow upper-level chemistry students to read, critique, and grade their 
classmates' papers. Results of the rubric were stored to a database and were available to the writer 
through an on-line search. The course was served using a Macintosh and the inexpensive software 
FileMaker Pro 4.0 and Claris Home Page 3.0. 

Predictors of Class Use of Computers 

Johan Van Braak, Vrije Universiteit Brussels, Belgium 

A survey was performed to investigate the influence of personal factors on class use of computers. 
Subjects were 236 secondary school teachers who were using computers, either for teaching or non- 
teaching purposes. A logistic regression technique was used to examine differences between class 
users and non-class users of computers on a set of personal characteristics: age, gender, computer 
attitudes, computer experience, technological and general innovativeness. Results indicate that only 
technological innovativeness and computer experience accounted for significant variance in explaining 
class use of computers. 

Problem Solving with the TI-92: A Report on a Problem Seminar 

Clifford Johnston, West Chester University, USA 

The paper will report on a graduate level Problem Seminar offered at West Chester University that 
focused on using technology, particularly the TI-92, to assist problem solving. The course merged the 
traditional problem seminar with an introduction to computer algebra systems and their applications. 
Traditional and non-traditional problems that required the use of technology beyond routine numerical 
computation were the focus of the course. In particular, problems from the fields of number theory, 
algebra, calculus, geometry, probability, and statistics were used to investigate the role of technology 
in problem solving. 

Integrating Space Science Research into an Interactive Web-Based Curriculum: 

Implementation and Evaluation 

Rita K. Karl, Lunar and Planetary Institute, USA; Leslie C. Hunt, University of Houston 

Clear Lake, USA. 

This poster illustrates two prototype web-based instructional modules created for the Lunar and 
Planetary Institute's Mars Millennium web site and CD-ROM project to support the National 
Aeronautic and Space Administration's Jet Propulsion Laboratory. 

Discovery Chemistry Using Statistics and Minitab 

Patrick Keller, Castleton State College, USA; Abbess Rajia, Castleton State College, 

USA 

Students entering general chemistry courses are weak in fundamental math skills and knowledge of 
statistics even though they have been exposed to basic concepts in statistics through their preparatory 
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math courses. There is a difficulty in transferring knowledge of statistics to science courses and this is 
found throughout the K-16 curriculum. The problem is that students lack statistical knowledge in the 
context of applications in sciences. Discovery Chemistry Using Statistics and Minitab overcomes 
these difficulties through its integrated and inquiry based laboratory approach. Most importantly, the 
course shows how statistics is a fundamental part of the process of acquiring knowledge in chemistry. 
The discovery approach includes an inquiry based laboratory designed to stimulate students to think 
creatively about analyzing and modeling data that they generate through experimentation. This 
laboratory environment helps immerse the student in a learning process that is rich in technology, data 
analysis and fundamental explorations in statistics and chemistry . Students are presented with a series 
of laboratory experiences in which they are asked to design experiments, collect, analyze and model 
data to solve problems while working in small collaborative groups. Each student generates data sets 
from his/her experiment and these data sets are pooled together to form a data base that is used for 
class discussion and to explain concepts in statistics. This integrated approach stimulates interest in 
statistics and encourages students to take the risk to ask questions and get engaged in a discussion. 
This teaching approach moves statistics from a pure methods approach to one which is founded in 
applications. 

Global Warming - Should We Worry? A Problem-based, Simulation, and Teamwork 
Approach to Teaching Integrated Science 

Terry Kiser, CSU, Chico, USA; Jeff Bell, CSU, Chico, USA; Richard Flory, CSU, Chico, 
USA; Randy Miller, CSU, Chico, USA; Roger Lederer, CSU, Chico, USA; James 
Pushnik, CSU, Chico, USA 

For the past year, a team of six faculty from the College of Natural Sciences at California State 
University, Chico have been working on the NSF-funded development of integrated science materials 
employing a problem-based approach and infusing computer modeling and simulation with traditional 
laboratory experimentation. This paper will report on a one-semester course we have developed based 
on the theme: Global Warming - Should We Worry? The course covers topics such as: an 
introduction to climate change with web-based research, an introduction to computer modeling and 
simulation using the program Stella, and a series of modules, Solar Radiation and The Earth, C02 and 
The Ocean, and Photosynthesis and Respiration, where computer models are developed tied to 
pertinent laboratory experiments. The course concludes with student teams taking on the task of 
representing various countries or regions of the world in a mock Kyoto accord. 

FCell3D: A Central Example to Visualize Safety Critical Processes in the 
Construction and Control of Distributed Applications 

Hans-F. Kotter, FernUniversitat Hagen, Germany; Norbert Volker, University of Essex, 
United Kingdom 

This paper reports on the design and implementation of a case study for the step-by-step development 
of distributed, safety critical control programs. The case study is a key ingredient in a new distance 
learning course for graduate students at the Electrical Engineering Department of the FemUniversitaet. 
It is implemented completely in VRML and Java and serves as a running, interactive example in our 
course. Via a variety of interfaces, students can model the control components and implement them in 
suitable programming languages. 

HIPPODAMUS: A WWW Based Expanded Learning Environment 

Georgios Kouroupetroglou, National and Kapodistrian University of Athens, Greece; 
Despina Deligiorgi, National and Kapodistrian University of Athens, Greece; Alexandros 
Pino, National and Kapodistrian University of Athens, Greece; Constantinos Viglas, 
National and Kapodistrian University of Athens, Greece; loannis Kalogiros, National and 
Kapodistrian University of Athens, Greece 

This paper discusses the theoretical model, the design, and the implementation of a learning web 
entitled HIPPODAMUS, namely a cluster of interactive networks of persons and technological 
networks which harmonically collaborate with the aim to perform effective learning. The technological 
networks include the equipment for supporting the studies of the students (e.g. specific measuring 
instruments or networks of sensors) as well as the technology for supporting the learning process (such 
as computer systems and networks and especially the Internet). HIPPODAMUS constitutes an 
expanded learning environment that incorporates extensive use of the Internet and its services, 




effectively promoting the active participation of all the partners involved in the educational process, 
namely of students, teachers, academic / research community and the administration of the education. 
This web is based upon the use of information and communication systems built for the World Wide 
Web, and it constitutes the application of an experimental educational framework on subjects such as 
Informatics, Technology and Environmental Education. HIPPODAMUS ties with the current trends 
and requirements, concerning the joined preparation of high-school students towards the Information 
Society, the Learning Society and the Environment-aware Society. 

Teaching Functional Programming for High School Students 

Tami Lapidot, Technion, Israel Institute of Technology, Israel; Dalit Levy, Technion, 

Israel Institute of Technology, Israel; Tamar Paz, Technion, Israel Institute of 
Technology, Israel 

Functional programming includes complex concepts and advanced ideas such as building abstractions 
with functions, compound data and list processing. As part of a new computer science curriculum for 
high school students in Israel, we developed a functional programming course, using DrScheme 
environment [1], based on recent research in science education that emphasizes the constructivist 
nature of learning. This paper deals with some preliminary findings from our field research and 
discusses some of the successes and difficulties of the high school students who took part in the course. 

A new efficient retrieval interface for primary school students 

Chien-I Lee, National Tainan Teachers College, Taiwan, R.O.C.; H. Chen, Graduate 
Institute for Computer and Education, National Tainan Teachers College,, Taiwan, 

R.O.C. 

Through the Internet, users can conveniently get their desired information. However, in general, it is 
not quite easy for the users get what they just want though the Internet by using some keywords to do 
the conventional full-text searching. Most notably, such a searching process will be a heavy load for 
primary school students who are not able to choose the proper keywords because they are not familiar 
with the knowledge and semantic words about their desired topic. Therefore, in this paper, we will 
propose a new retrieval interface for primary school students, called leading-question retrieval 
interface, which applies a series of questions to inquire and analyze the answers from the users to 
understand their queried intentions. Such an inquiring process is embodied with the spirit of 
Construction and can omit the difficult task to choose proper keywords. 

Classification and discussion of recursive phenomena by computer science 
teachers 

Dalit Levy, Technion, Israel Institute of Technology, Israel 

Recursion is a significant concept, appearing in almost every introductory course in computer science 
(CS). CS educators and educational researchers often refer to difficulties in learning and teaching 
recursion. However, the research literature barely addresses the unique ways in which students and 
teachers relate to this interdisciplinary concept and their particular language concerning recursive 
phenomena. This paper reports on a study in which groups of mathematics and computer science 
teachers collaboratively classified and discussed several recursive phenomena. The discourse was 
recorded and analyzed, and a grounded categorical system was formed and examined. Preliminary 
results indicate some basic aspects of recursion in the discourse, although these teachers apparently 
talk a slightly different language from that of expert computer scientists. Some ‘potentially rich’ 
discourse episodes were evident as well, representing conflicts among alternative conceptions. Such 
episodes can serve as a springboard for further understanding of recursive phenomena. 

USD's Web Group: A service learning experience in Computer Science 

Jane Friedman, University of San Diego, USA; Luby Liao, University of San Diego, USA 

This paper will describe the University of San Diego’s web group, an unique and innovative service- 
learning experience for computer science students. 

An integrated common theme-based web site for teaching Science and 
Technology in Australian Primary Schools 

Min-Jin Lin, National Hualien Teachers College, Taiwan, R.O.C. 

The paper describes an integrated common theme-based web site that supports the teaching of Science 
and Technology in Australian primary schools. There are ten components in the web site. The 
"Background Information" component strengthens teachers' background scientific knowledge and 



skills. The "Content Strands", "Learning Outcomes", "Program Overviews", and "Links to other key 
learning areas" components assist Australian primary school teachers implementing the theme-based 
programs for teaching Science & Technology. Moreover, the "Internet Lesson Plans" and "Teaching 
Resources" components help teachers to reflect on their designs of the program. The "Fun Web Sites 
for Kids" motivates students to learn by exploring fun sites that are specially designed for children. 
The "Ask Expert a Question" and "News Discussion Group" components help teachers to solve 
problems in subject domain or teaching. This web site reveals the common theme-based characteristics 
of Australian primary curriculum, and it contributes to improve Australian primary school science 
teaching. 

Representation of Problem-Solving Procedures in MathCAL 

Janet Lin, National Taiwan Normal University, Taiwan; Jie-Yong Juang, National Taiwan 
University, Taiwan; Ponson Sun, National Taiwan Normal University, Taiwan 

MathCAL is a network-based learning system for users to practice mathematical problem solving. 
Math knowledge is pre-analyzed to derive a set of macro functions for use in solving problems in a 
specific domain. Each macro function typically represents a math concept or rule which may be used 
to transform a math problem from a state into the next. Learners select problems to work on from the 
problem bank and proceed with problem solving step by step. The kernel of the system uses Petri nets 
to dynamically record a learner's problem-solving activities. The Petri-net representation allows the 
system to determine appropriateness of a user's application of a function at a certain step. It also 
enables the system to understand a user's thinking process when it is requested to offer guidance. 
MathCAL also supports synchronous and asynchronous network functions which may be used to 
establish a collaborative problem-solving environment. In addition, MathCAL allows users to add new 
problems and/or new solution paths to its databases. 

PCLogo and Mathematical Thinking Processes 

Leping Liu, Towson University, USA 

While Piaget's theory of cognitive development stages and van Hiele's theory of geometrical thinking 
levels emphasize the "state" of children's thinking, and describe the characteristics and applications of 
thinking at each particular stage or level, this paper demonstrates the thinking "processes" that advance 
thinking from one level to another higher level, with a C-A-C (con crete -abstract- con crete) learning 
model. Specifically, the C-A-C model using PCLogo assumes that repeated practice on concrete 
procedures of solving geometry tasks can lead a child's thinking to a higher level of abstract thinking. 
However, how much practice can be considered "enough"? This paper investigates how many tasks, or 
what difficulty-level of the tasks would be necessary for a child to advance his/her thinking from 
concrete level to abstract level and solve the abstract geometry problems. Current data and results in 
this is on-going study indicate that different "amount" of practice makes significant difference in 
children's geometry concept learning. 

Math in a Web Environment 

Marcelo Llarull, New Jersey City University and William Paterson University, USA; 

This paper addresses two issues, one is writing mathematical expressions on the web and the other is 
creating interactive math websites to teach and leam mathematics. In both cases, helper applications 
play a crucial role to successfully achieve both. 

The Development of an Index to Measure Sense of Learning Community in 
Computer Science 

Robert Lucking, Old Dominion University, USA; Fred Rovai, Old Dominion University, 
USA; Dean Cristol, Old Dominion University, USA; & Katherine King, Old Dominion 
University, USA 

The purposes of this study were to develop, refine, and field test the Sense of Learning Community 
Index (SLCI), and to determine its validity and reliability for use with college students in traditional 
and distance education environments. The 40-item SLCI measures sense of learning community within 
a group of learners. The SLCI was field tested with university students in traditional and synchronous 
distance education courses. Data were collected from 135 students. Instrument reliability is very high 
(Cronbach's coefficient alpha = .97). The SLCI also exhibits high content validity covering the 
domains of collaborative learning, teamwork, shared goals, and active creation of knowledge and 
meaning. No evidence of differences in sense of learning community was found between traditional 
and distance learning courses and between content areas. However, differences were found between 
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groups taught by different instructors. It was concluded that the SLCI is an effective measure of sense 
of learning community. 

Project Links: Interactive Web-based Modules for Teaching Mathematics and Its 
Applications 

Kenneth S. Manning, Ph.D., Rensselaer Polytechnic Institute, USA 

Project Links at Rensselaer is a cooperative effort to develop materials linking mathematical topics 
with their applications in engineering and science. The product of this effort is a set of interactive, 
web-based learning modules that rely on hypertext, animations, and interactive Java applets. We 
employ interactive web-based modules in the studio classroom environment, pioneered at Rensselaer, 
to engage students in guided learning. The intent is to provide students with an experience unavailable 
in traditional lecture or textbook lessons. These modules are designed for use in more than one course, 
with a topic-qualified instructor and assistant available in the classroom during use. They are not 
intended as self-paced learning modules, nor as text replacements, but are to supplement existing 
courses with a degree of interactivity and universality not available before the advent of the World 
Wide Web. There are currently 47 modules in development. All modules will be available for 
examination. 

Student-Instructor E-mail Exchange in Active-Learning Biol 100 

Gili Marbach-Ad, University of Maryland Baltimore County, USA; Phillip G. Sokolove, 
University of Maryland Baltimore County, USA. 

Student- instructor communication was examined in a large, introductory biology class for majors 
(enrollment -250). Students were encouraged to send questions, comments and suggestions to the 
instructor using e-mail. All messages were collected after the semester and classified as either content- 
related or procedural. Content- related messages typically contained questions, comments or 
suggestions about a topic that had been discussed the same day in class. Procedural messages included 
questions or requests concerning homework exercises and exams, reports about student absence from 
class, or requests to switch classes or sections. Messages from females and males reflected class 
gender distribution, but Asian and African Americans were more likely than Caucasians (relative to 
their class distribution) to send content-related messages. Most students whose messages were 
classified as content-related had earned final grades of A or B. 

Developing Prairie to Mountain Explorer: A GIS and Remote Sensing Data Set for 
the Fifth-Twelfth Grade Classroom 

Patricia McClurg, University of Wyoming, USA; Alan Buss, University of Wyoming, USA 
Results of a three-year collaborative investigation into what constitutes viable GIS data sets for use 
with fifth through twelfth grade students will be reported and the product Prairie to Mountain Explorer 
(PTME) will be demonstrated. This collaboration involved teachers, teacher educators and scientists 
participating in a NASA funded five-state consortium (Upper Midwest Aerospace Consortium- 
UMAC). PTME is a spatial data base which provides a rich context for student investigations using 
the Internet, Geographical Information Systems (GIS), Global Positioning Systems (GPS), and 
Calculator Based Laboratories with sensing instrumentation (CBL). PTME contains selected base-line 
data sets at regional and county scales (ranging from 1:2,000,000 to 1:100,000), and a user’s guide 
with meta-data for over 300 themes. Results from extensive pilot testing coupled with input from 
agriculture/natural resource researchers contributed to this powerful educational resource. UMAC 
maintains a web-site to support PTME and to provide a growing resource of classroom tested lesson 
plans (nasc.uwyo.edu/edparc). 

Math and Science Software for the Young Child: Developomentally Approporiate 
or Marketing Ploy? 

Robin McGrew-Zoubi, Sam Houston State University, USA; Joan Livingston Prouty, Sam 
Houston State University, USA; Kim Arp, Sam Houston State University, USA 

This paper describes a study of mathematics and science software marketed for preschool children. 
Preservice teachers observed young children at work, reviewed the literature available about computers 
and young children, and interviewed early childhood, technology, mathematics, and science specialists. 
Teachers, childcare providers, and parents shared their beliefs about the value of computers for young 
children. Analysis of specific software packages and their alignment with developmental benchmarks, 
still in progress, will be presented. 
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Modelling Three-Dimensional Surfaces On A Spreadsheet 

Abas Md Said, Universiti Teknologi Petronas, Malaysia; Mohd Yunus Nayan, Universiti 
Teknologi Petronas, Malaysia 

This paper describes how three-dimensional surfaces can be drawn using an electronic spreadsheet. 
This program is useful and an inexpensive way for both teachers and students to visualize 3D surfaces 
from almost any angle and interval. This when blend and together with theory will be a promising 
approach for them to get a firmer understanding of the subject. 

LAAP: Learn Anytime Anywhere Physics I 

Jerry Meisner, UNCGreensboro, USA; Harol Hoffman, UNCGreensboro, USA; Mike 
Strickland, U. Washington, USA; Wolfgang Christian, Davidson College, USA; Aaron 
Titus, NCA&T, USA 

The Extended Physics Community Consortium will author Learn Anytime Anywhere Physics (LAAP). 
LAAP will provide both synchronous and asynchronous learning experiences for undergraduate 
students, high school physics students with various needs as well as preservice and inservice teachers. 
We will use Java technology to develop and build an online physics laboratory learning environment 
comprised of typical introductory, algebra-based physics modules, in an innovative pedagogically 
sound format: - virtual lab equipment applets (Laaplets) - virtual lab setup device applets (Laaplets) - 
associated curriculum modules in which students perform experiments in the virtual lab - student 
assessment components - peer interactions and peer mentoring By means of interactivity between 
client machine and servers, student input will be stored in server side databases. This will permit just in 
time analysis (JIT A) for immediate feedback. 

Inservice programs: Does Their Effectiveness Last? 

Michelle Merriweather, West Chester University, USA 

This paper discusses the findings of a study conducted on two types of in-service programs. The 
program, Virginia Network for Technology (VANT) consisted of an overview course and an intensive 
course. The study examined the differences in both the attitudes toward and actual use of calculators 
between the participants who participated in the overview course, intensive course, and those who did 
not complete either course. The results indicate a trend that after attending VANT, teachers 
incorporate technology into the classroom and continue to use it in the years following VANT. In 
addition, the teachers who participated in VANT have a more positive attitude toward calculator use in 
the mathematics classroom than when they first completed VANT. However, there was not a 
significant difference in attitude between those who completed the overview course, intensive course, 
and those who did not complete either course. 

Quantitative courses in distance learning 

Antoni Meseguer-Artola, Universitat Oberta de Catalunya, Spain 

In distance learning through Internet, where the Universitat Oberta de Catalunya (UOC) is one of the 
pioneers in the world, the particular type of students attending the courses and the difficulties in the 
transmission of mathematical texts create the necessity of developing new strategies which facilitate 
the learning-training process. These strategies are based on the development of ad-hoc learning guides 
that establish a particular link between self-directed learning and directed learning. We focus our study 
on a particular type of courses: quantitative courses, i.e,, courses that use mathematical language for its 
development or courses where mathematical concepts are the aim of study. The design of appropriate 
learning guides for quantitative courses and their classification are the main objectives of this paper. In 
this sense, from different educative experiences in low, medium and high level courses in mathematics, 
this work proposes different items that a learning guide has to contain and it also gives a classification 
criteria of such these guides. 

Discovering xyAlgebra: Intelligent Interactive Internet Instruction 

John Miller, The City College of CUNY, USA 

Passive activities such as watching presentations, listening to explanations of general principles and 
watching experts solve sample problems are helpful, but peripheral, to the mathematical learning 
process. For students the indispensable step is solving problems for themselves. Yet most commercial 
mathematics software still concentrates on presentations and sample problems, while sending students 
off line to do practice problems on paper without interactive support. Answers are either multiple 
choice or limited to a single simplified final step. Early Internet courses are even less interactive. In 
contrast, students using xyAlgebra can enter each step of each problem solution. They enjoy 
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intelligent support at every step as xyAlgebra's suggested solution strategy changes in response to their 
steps in simplifying expressions, solving equations and even in setting up and solving verbal problems. 
The next version of xyAlgebra will support instruction over the Internet, yet the entire package can be 
downloaded without cost at mathO.sci.ccnyxuny.edu/xyalgebra. 

Discovering xyAlgebra: Intelligent Interactive Internet Instruction 

John Miller, The City College of CUNY, USA 

Passive activities such as watching presentations, listening to explanations of general principles and 
watching experts solve sample problems are helpful, but peripheral, to the mathematical learning 
process. For students the indispensable step is solving problems for themselves. Yet most commercial 
mathematics software still concentrates on presentations and sample problems, while sending students 
off line to do practice problems on paper without interactive support. Answers are either multiple 
choice or limited to a single simplified final step. Early Internet courses are even less interactive. In 
contrast, students using xyAlgebra can enter each step of each problem solution. They enjoy 
intelligent support at every step as xyAlgebra's suggested solution strategy changes in response to their 
steps in simplifying expressions, solving equations and even in setting up and solving verbal problems. 
The next version of xyAlgebra will support instruction over the Internet, yet the entire package can be 
downloaded without cost at mathO.sci.ccny.cuny.edu/xyalgebra. 

Building and Using Simulation Based Environments for Learning about Complex 
Domains 

Marcelo Milrad, The Institute for Media Technology, SWEDEN; J. Michael Spector, 
University of Bergen, Norway; Pal Davidsen, University of Bergen, Norway 

A variety of substantive issues confront education with respect to technology support for learning 
increasingly complex knowledge. How can learners acquire and maintain deep understanding about 
difficult-to-understand subjects? We argue that because students are learning for real life and preparing 
to solve real complex problems in the future, the complexity of the world should be taken into account 
much more and much earlier than usually happens. In this paper we describe and illustrate our 
approach to the design of interactive learning environments for complex domains and the role 
technology can play on these environments. 

Using Controls to Construct Dynamic Spreadsheets for Teaching Math and 
Physics: the Design of Interfaces and Worksheets. 

Simon Mochon, Center for Research and Advanced Studies, IPN, Mexico 

In this article we discuss the advantages of using controls in spreadsheets for educational purposes. 
The most evident is that graphs change in a dynamic way, which gives a powerful visual support to the 
understanding of the situation represented in the spreadsheet. We will show some spreadsheets with 
controls that were designed for an educational project in Mexico to teach math and physics with 
computers. The article also describes the structure given to the corresponding worksheets and the 
pedagogical model followed within the classroom to ensure an efficient use of the computational 
activities developed. 

Science education in alternative programs: Building bridges with technology 

Barbara Moore, The University of South Florida, USA 

Science educators, using technology, can build bridges across the digital divide by helping alternative 
education students graduate and break the cycle of poverty. Alternative students often miss various 
segments of content. The results are poor grades and low scores on standardized tests. These students 
need resources for self-paced acquisition of knowledge, comprehension, and application levels of 
missing content. They also need resources for individualized drill and practice, as well as stimulation 
of higher level thinking skills. The Digital Bridge, URL 
http://typhoon.coedu.usf.edu/~bmoore/bridge.htm, is an on-line learning resource designed to address 
individual differences in student learning style and ability. The site offers short, self-paced units of 
content. It features objectives, key terms, tutorials of several types, links to related information, 
flashcards, and timed quizzes. The Digital Bridge helps students learn and allows teachers to focus on 
individual students or community-based class projects. 



The Effects of Technology on an Undergraduate Mathematics Department 

Leigh Myers, Northwestern State University of Louisiana, USA; Stan Chadick, 
Northwestern State University of Louisiana, USA 

Technology in hand-held form is changing the manner in which we teach mathematics. The first and 
most important question is whether to require every student to have a graphing calculator. An 
immediate effect is the classroom itself with calculators in the hands of all students and an overhead 
for the instructor. The positive effect on the faculty, curriculum, and pre-calculus sequence makes the 
change to mathematics with technology worthwhile. We look forward to future developments in 
technology and their impact on mathematics. 

Mining The Internet: Integrating Real-World Data And Interactivity In The Online 
Classroom 

Gerald "Jerry" Nelson, Casper College, USA; Susan Nelson, Casper College, USA 

The internet does three things extremely well that can promote interactivity in the online classroom: 
communications, immediacy of data, and the internet's ability to archive data sets. These three taken 
together can produce opportunities for true interactivity between students and scientific theory and 
mathematics. 

A Computer Simulator Can Transform "Dictums of Authority" into "Evidence" for 
Model Construction in Physics 

Valerie Otero, San Deigo State University, USA; Fred Goldberg, San Diego State 
University, USA 

Urban systemic reform initiatives call for increased use of computers in K-12 science classrooms. It 
therefore becomes increasingly important to understand how particular types of computer software and 
pedagogical structures can support interactions that lead to meaningful learning by students. In this 
paper, we describe some results from our research that focuses on learning in a collaborative-inquiry 
science classroom. We have found that the computer can make a difference in this environment. We 
discuss how special computer simulators made it easier for groups of students to construct explanatory 
models. It did so by providing the opportunity for students to make model-like observations that could 
not be made using hands-on apparatus. Model-like computer results helped students bridge the gap 
between phenomenological and conceptual domains. 

From the abstract to the practical: How the Motion Media Grapher helps students 
understand and interpret abstract mathematical concepts 

Evangeline S. Pianfetti, University of Illinois, College of Education, USA; Brian Pianfetti, 
University of Illinois, College of Education, USA 

Hiebert & Carpenter (1992) state that "school-learned procedures often cannot be used flexibly to solve 
problems other than those on which they were practiced, and thus, do not transfer well (p. 79). The 
Motion Media Grapher (MMG) is a Web-based software utility created by the authors of this paper to 
help students make the link between the abstract mathematical concepts they learn in the classroom 
and their occurrences in the real world. The students may easily interact with the MMG and it may be 
efficiently adapted by classroom teachers for integration into an existing curriculum. The MMG 
attempts to enhance the students' internal representations with socially situated events. Hence, the 
concepts are taught through their application in familiar environments and not in abstraction. Based on 
a yearlong research study, this paper introduces its readers to the MMG and discusses its efficacy as a 
visualization tool for high school mathematics students. 

Issues Involved in a Large Scale Implementation of Web-Based Mathematics 
Instruction 

Michael Pilant, Texas A&M University, USA; Robert Hall, Texas A&M University, USA; 
Janice Epstein, Texas A&M University, USA; Yvette Hester, Texas A&M University, 

USA; Arlen Strader, Texas A&M University, USA 

As the capability of the World Wide Web (WWW) for delivery of mediated instruction increases, it is 
natural to consider it as a primary delivery mechanism for distance education. Several issues must be 
addressed, however. Two of these issues, access and ease of use, are primarily matters of technology. 
As equipment gets better and more affordable, we move closer to the goal of "universal access." Two 
other issues, assessment and motivation, are more complex due to human factors, thus, involve long- 
term research efforts. This study addresses each of these issues but focuses principally on problems 
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associated with assessing student performance and increasing motivation in mathematics via self- 
contained, interactive, web-based instructional modules. For the past several years, a traditional finite 
mathematics course has been the testbed for developing web-based instructional methods. Results 
from this long-term project are summarized. 

Technological Tools to Enhance Performance in Calculus I 

Olga M. Ramirez, University of Texas-Pan American, USA; John E. Bernard, University 
of Texas-Pan American, USA; William Heller, University of Texas-Pan American, USA; 
Wendy A. Lawrence-Fowler, University of Texas-Pan American, USA; Gerald Brazier, 
University of Texas-Pan American, USA 

In 1998, the Minority Student Improvement Program at the University of Texas- Pan American, 
Edinburg, Texas began the process of developing and implementing an enhanced instructional model 
for Calculus I that integrates technological tools for teaching and evaluation of learning purposes. The 
objectives of this work focus on developing and disseminating an affordable, highly interactive, 
student-centered learning environment which will increase success rates for minority science and 
engineering students enrolled in Calculus I. As a result of the project, faculty aim to better help 
students gain understanding of different types of significant mathematical knowledge that will further 
assist them to succeed in Calculus I and beyond. A questionnaire was developed to assess descriptive 
and content knowledge variables. The preliminary results of the data collected via the questionnaire 
comprise a part of this paper, as well as the ramifications of the students’ level of preparedness as 
measured by key questionnaire items, and some specifics about the instructional modifications that are 
being made to meet the students’ needs. 

The application of Maple V in learning activities for courses in transport 
phenomena 

Araceli Reyes, Instituto Tecnologico Autonomo de Mexico, MEXICO; Bernardo 
Hemandez-Morales, Universidad Nacional Autonoma de Mexico, MEXICO 

Courses on Transport Phenomena (Fluid Flow, Heat Transfer and Mass Transfer) are taught at the 
junior level in the engineering curricula. These courses require the use of mathematical-oriented skills, 
in particular the application of methods for solving differential equations, in the context of an applied 
problem. To aid in the learning process, we are developing a series of activities based on the Maple V 
R4 software package — a language for symbolic mathe-matical calculation. Each activity is based on a 
Maple V R4 worksheet, accompanied by a handout. The worksheet must be completed by the students 
as an extra-class activity. The handout is divided in two parts: i) a brief descrip-tion of the problem, 
where the objective of the exercise is clearly defined; and ii) instructions on how to complete the 
worksheet, followed by questions that can only be answered after the worksheet has been successfully 
completed. 

Math/Science/Technology: An Academic Major. 

Timothy Riegle, Kean University, USA 

This is a report of a current developmental efforts for a Liberal Arts based academic major in Math, 
Science & Technology. There are still a number of serious issues that need to be addressed. There are 
discipline specific views that could be seen as having very little common ground. The flexible and 
equitable resolution of those issues can lead to an exciting and valuable program. 

Flexible Generation of Animations Using Animal 

Guido Roessling, University of Siegen, Germany; Bemd Freisleben, University of 
Siegen, Germany 

ANIMAL is a tool for generating animations suitable for integration in lectures. Animations can be 
generated by visual editing using drag and drop, scripting using the built-in scripting language and 
generation by function calls in the ANIMAL API. ANIMAL offers the primitives point, polyline / 
polygon, text, arc and list element. All elements are adaptable to subtypes such as square, ellipse or 
circle segment. Animations consist of separate steps containing an arbitrary number of effects each. 
Current effects include show/hide, move, rotate and change color and can be given both offset and 
duration, measured in milliseconds or internal time units. Both scripting and API support inclusion of 
source/pseudo code with indentation, element and code highlighting, arrays including index pointers 
and relative object placement. Automating animation generation is easily accomplished. The resulting 
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animation files seldom exceed lOkB. ANIMAL is implemented in Java and available at 
http://www.informatik.uni-siegen.de/~inf/Software/Animal/. 

Hypertexts and Hypermedia to Present the Interconnections Between Mathematics 
and Arts 

Nicoletta Sala, Academy of arch- University of Italian Switzerland, Switzerland 

The computer plays a central role in educational environment, for this reason I describe an 
educational approach where some mathematical concepts are presented with their artistic 
connections, using also the hypermedia, and the Web. For example, to explain the platonic solids and 
the polyhedra I have used some hypertexts and hypermedia (on CD-ROM and online) and I have also 
researched in the Internet some interesting Applet Java. At the Internet address: http:// home.a-city.de/ 
waiter. fendt/mathengl/platonengl.htm there is an Applet Java which contains an animation where we 
can choose and rotate the platonic solids (changing the rotation angle). To present the polyhedral 
components and the tessellation in the M.C. Escher's paintings I have proposed to my students the 
CD-ROM Escher Interactive (for Windows ) which contains an audio/ visual life of M. C. Escher and 
videos of the artist at work. To introduce the basic concepts of the fractal geometry I have created a 
hypertext using HTML language. It is available at the Internet address: http: // www. arch.unisi.ch / 
ffactals/ffactle.htm inside of my hypertext there is a page dedicated to the fractal architecture with the 
building's self-similarity (e.g., an Indian fractal temple, the fractal floor of the church of Anagni, 
Italy). 

Mathematics, Arts, and New Media : Some Interesting Interconnections 

Nicoletta Sala, Academy of Arch. - University of Italian Switzerland, Switzerland 

Imagination and creativity are among the qualities of a good mathematician. The academic 
mathematics course has become, for many students, a highly structured sequence of definitions, 
theorems, and proofs that lead only to additional definitions, theorems, and proofs. This work 
describes an educational approach, in two different undergraduate course (first and fourth year), where 
some mathematical concepts are presented with their artistic connections (e.g., the polyhedra, the 
golden section, the fractal geometry, and so forth), using also the new educational tools (e.g., 
hypertext, hypermedia, virtual reality). I refer of my experience at the Academy of Architecture of 
Mendrisio, University of Italian Switzerland where I have researched the interconnections between 
Mathematics, Arts and Architecture using the new media and I have observed that they can help: to 
reach good cognitive goals, to increase the students' attention, to do more interactive the learning 
process. 

ZELIG: Statistics For All 

Teresa Sancho, Universitat Oberta de Catalunya, Catalunya; Antoni Meseguer, 
Universitat Oberta de Catalunya, Catalunya; Francesc Vallverdu, Universitat Oberta de 
Catalunya, Catalunya; Eloi Batlle, Universitat Oberta de Catalunya 

This work presents a web-format framework for teaching and learning Statistics in the Universitat 
Oberta de Catalunya (UOC). UOC is an Open University with a virtual campus where both students 
and teachers interact, breaking time and distance constraints. The learning and teaching process is 
evolving with the information and communication technologies. These technologies facilitate the 
interaction between the student and the material through the resolution of exercises and the 
experimentation with simulated cases. Statistics is a transversal subject or tool used, at different levels 
and skills, in most of Higher School studies. In this sense, we propose a digital and navigable didactic 
framework that integrates the basic elements of the self-learning process and adapts the learning 
material to the student, according to his personal profile (career, previous knowledge, skills, behavior, 
etc). A tailor-made and oriented evolution implies an intelligent tracking of the student’s actions. In 
this respect, we might say that this kind of activity allows either the student to learn significantly or the 
teacher to keep the process under control. 

Evaluation of Web-Based Instruction: A Case Study in Brazilian High Schools 

Dietrich Schiel, University of Sao Paulo, Brazil; Joan Dassin, Fulbright Comission, 

United States; Monica Magalhaes, Sao Paulo State University, Brazil; Iria Guerrini, 
University of Sao Paulo, Brazil 

This paper describes the evolution of a distance education program where students perform physical 
experiments in their school assisted by a distance tutorial system. 20 public high schools in 14 cities in 
the interior of Brazil participate. Using an already described evaluation method which works on-line, it 
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were collected the opinions of a sample of 228 students from an universe of 2200 participants. The 
results indicate a positive impact on students learning and success in helping a distant teacher and his 
(her) students in the innovating experimental activities. 

Realizing an IDEA I Computer-aided instruction and learning 

W. Udo Schroeder, Univ. Rochester, USA 

An Interactive Distributed Educational Application (IDEA) has been realized for an undergraduate 
physical-chemistry course at the University of Rochester. It supports the educational goals of 
generating a more intuitive, yet realistic, understanding of complex, abstract physical theory by the 
students and helping them develop numeracy and important skills in actively simulating physical 
processes. Interactive Study/Lecture Notes (ISLN), containing an electronic text, hyper-linked to 
explanations, tutorials, “hot” data plots, simulations, and quizzes, represents the core of the IDEA. 
They are embedded in a Web-based course frame, together with course annunciator and communicator 
segments. ISLNs and course frame have been produced with MS-Word TM and MathcadTM software 
and can be viewed with freely available browsers. This widely used software makes the tasks 
achievable for both students and instructor. The IDEA course system has been accessible via the 
University’s local network but may serve as a more general model of an effective self-paced, distance- 
learning environment. 

Computer Enhanced Learning Environments for Meta-Competencies in Software 
Engineering 

Mildred Shaw, University of Calgary, Canada; Brian Gaines, University of Calgary, 
Canada 

Industrial priorities for the competencies of both undergraduate and graduate software engineers 
include not only technical knowledge but also meta-competencies which are not normally addressed in 
standard computer science learning environments. These meta-competencies include the capability to 
operate effectively in teams and to be able to communicate with customers, suppliers and co-workers. 
This article describes the underlying principles, practical implementation, and several years experience 
with the learning environments at both undergraduate and graduate level that support the rapid 
development of such meta-competencies within the framework of normal academic courses. 

Using Graphing Software, Computers And Ekg's To Help Students Learn About 
The Behavior Of The Heart 

Leonard Simons, Elmira College, USA; Jerry Przybylski, Elmira College, USA 

Reading the output of an EKG is often confusing for students in beginning biology courses. A variety 
of distances, ratios and slopes need to be read from the graph to obtain the pertinent information for 
describing the behavior of the heart. However, many students in these classes do not have a good 
background in graphical analysis. We propose that doing some mathematical work in a biology course 
before encountering circulation lab activities will greatly aid in the students' understanding of the 
material. The students first generate some veiy simple graphs. They see how various distances, slopes 
and ratios obtained from the graphs describe different quantitative behaviors. The students work 
through a small set of increasingly complicated periodic graphs leading to a graph that looks like the 
output of an EKG. Then, when running the actual EKG’s, the students can concentrate on the 
biological concepts rather than learning new mathematics. 

Grades 4 and 5 Teachers' Perceptions of Technology Implementation in 
Mathematics Instruction 

Scott W. Slough, Georgia Southern University, USA; Gregory E. Chamblee, Georgia 
Southern University, USA 

The purpose of this paper is to examine and describe the change process as technology is implemented 
in grades 4 and 5 mathematics classrooms. For this study technology is defined as manipulatives, 
calculators and computers. The Concerns Based Adoption Model (CBAM) provided a theoretical 
framework for data analysis. Data was collected through open-ended ethnographic interviews of six 
(n=6) grades 4 and 5 demonstration teachers identified by the university. Results were organized into 
four major themes: perceptions of technology (personal), availability and use of technology 
(technological), implementation of technology in the mathematics classroom (curricular), and 
technology’s role in teaching mathematics (philosophy). 




I.MO.PHY. a net-course supporting the Introduction to Modeling in Physics 

education at high school level 

Rosa Maria Sperandeo-Mineo, University of Palermo, Italy 

IMOPHY (Introduction to Modeling in PHYsics-education) is a teacher training Course delivered on 
the Web. It consists of various Net-Seminars (on line seminars using on-line discussion groups) 
concerning different physics topics. Each Net-Seminar is tailored to train teachers in transforming their 
teaching by promoting a constructivistic teaching practice and computer-enhanced instructional 
approaches that enable students to learn about the process of modeling physical phenomena. The Net- 
Course approach involves a construction of the physics content structure that has to be taught not 
mainly, or even solely, oriented to physics issues but also including educational issues and pupils’ 
conceptions. These two issues, students spontaneous models and statements of the scientific 
knowledge, are therefore accepted to be of the same relevance and treated as resources for physics 
education. The Net-Seminar about thermal interaction between bodies will be described and the 
pedagogical tools prepared (experiments using Microcomputer Based Laboratory and software) will 
be analyzed. 

Interactive Distance Education: A Database Model to Facilitate Peer Interaction for 

Asynchronous Learners 

G. A. Stringer, Southern Oregon University, USA; J. J. A. Smit, Potchefstroom 

University, South Africa;P. J. Enslin, Potchefstroom University, South Africa 

A pilot project at Potchefstroom University has tested the feasibility and effectiveness of using a 
database to store and retrieve peer interactions for asynchronous telematic learners. The study 
involved twelve members selected from a cohort of 43, enrolled in the second year of Project SEDIBA, 
a residential certificate program designed to upgrade the skills of science teachers from black rural 
high schools. A telematic module consisting of three units on basic electricity was developed using the 
database model. Practical work required in the module was done using a loaned electronic parts kit. 
Pre- and post-testing made use of an instrument called DIRECT developed and tested at North 
Carolina State University. Normalized learning gains of 0.10-0.12 were measured for the pilot and 
control groups. 

The Effectiveness of a Computer-Interfaced Experiment in Helping Students 

Understand Chemical Phenomenon 

Jerry P. Suits, McNeese State University, USA 

This paper discusses the use and evaluation of a computer- interfaced experiment (CAL-001) in helping 
college students understand and appreciate a common chemical phenomenon — an acid/base titration 
curve. This study included two subgroups based upon academic major, i.e., Chem 110 students in 
science and engineering majors, and Chem 123 students in nursing and agricultural majors. Results 
showed that most Chem 1 10 students selected CAL-001 as their favorite experiment, whereas Chem 
123 students were ambivalent about it. Many of the Chem 1 10 students who liked CAL-001 expressed 
a metacognitive awareness of the conceptual/analytical nature of the experiment. The graphic 
representation of CAL-001 (mL titrant vs pH) may serve as a bridge that connects the more concrete 
level of hands-on laboratory activities to the more abstract mathematical/symbolic representation level. 

Teaching "Computers & Society" - The Medium and The Message 

Brendan Tangney, Trinity College Dublin, Ireland; Bryn Holmes, Trinity College Dublin, 

Ireland; Ann FitzGibbon, Trinity College Dublin, Ireland 

There are a number of significant challenges faced in teaching Computers & Society courses. The 
research described in this paper is based upon experience with teaching one such course. In-class group 
debates are the cornerstone of the course and these have been recorded and analyzed with a view to 
understanding what specific pedagogical forces are at work. The analysis to date suggests that in the 
teaching and model being used significant peer learning is taking place, students learn how to adopt 
different ways of interaction and collaboration depending upon the role that they are performing and 
that cognitive skills can be supported by allowing learners the opportunities to chunk information into 
smaller, meaningful parts. Above all the analysis supports the view that learning environments are key 
to the development of intellectual skills. 




Learning Mathematics Through Image Processing: Constructing Cylindrical 

Anamorphoses 

Steven Tanimoto, University of Washington, USA; James King, University of 

Washington, USA; Richard Rice, Alias/Wavefront, Inc, USA 

Anamorphic images are distorted images that can be seen normally when viewed in special ways. A 
very popular form of anamorphosis in the 1700s and 1800s is a type of image that is intended to be 
viewed by placing a cylindrical mirror in the middle of it and observing the reflection. These images 
are fun to look at because without the mirror, an observer can make out just enough of the structure of 
the scene to be tantalized, and then the cylindrical mirror brings a visual resolution to the puzzle, 
answering the question "What is it supposed to really look like?" These kinds of images can be used 
today in compelling educational activities involving mathematics and computers. With the aid of 
special software for image processing in a mathematics context, students can construct their own 
anamorphic images while learning about image transformations, polar coordinates, ray tracing, digital 
image representation, and programming of computer operations on images. 

Critical Issues in Distance Education: Partnership, Content, and Delivery 

David A. Thomas, Montana State University, USA 

This paper addresses three issues critical in the development of high-quality distance education courses 
in mathematics, science, and engineering: Creating stakeholder partnerships; reforming the content of 
mathematics and science education; and developing powerful, adaptable WWW-based instructional 
delivery systems. As each issue is discussed, recommendations are made for engaging interested 
parties in government, education, and the private sector in a search for solutions. 

Teaching of “Spreadsheets- design and use” by Learning Activity Package 

Daniela Touparova, "N. Rilski" South-West University, Bulgaria 

The focus of this paper is application of Learning Activity Package (LAP) and the Web- based variant 
of LAP in teaching "Spreadsheets- design and use”. In the Section 1 the background of education 
concerning Information Technology (IT) and Computer Science(CS) in Bulgarian secondary school is 
described. Section two deals with the architecture of LAP. More precisely the types of problem solving 
tasks and their components are proposed and discussed. Section 3 concerns the analysis of the 
experimental study of using LAP for module "Spreadsheets- design and use.". The study has been 
carried out with 184 students from Language School and Vocational School in Business and 
Agriculture. In Section 4 one point of view for Web- based presenting of LAP are given. Also some 
ideas for future research of application of Web- based LAP in teaching different IT and CS modules at 
the Bulgarian Secondary Schools are discussed. 

A Navigable Book To Learn Discrete Mathematics 

Francesc Vallverdu, Universitat Oberta de Catalunya, Catalunya; Teresa Sancho, 

Universitat Oberta de Catalunya, Catalunya 

This work will discuss on a course material in web-format for teaching and learning Discrete 
Mathematics, a subject that is offered at the Computer Science School of the Universitat Oberta de 
Catalunya (UOC). UOC is an Open University with a virtual campus where both students and teachers 
interact, breaking time and distance constraints. The learning and teaching process is evolving with the 
new information technologies. The teacher-student relationship is changing, even more in distance 
education. The interactivity between the student and the material can be done through the resolution of 
exercises and the experimentation with simulated cases. The simple exercises are usually Java Applets 
embedded in the same html page where the exercise evolves, in a xml framework. Depending on the 
student’s behavior and skills, different paths are presented in order to optimize the learning process. 
The more the student knows, the more difficult questions are. A tailor-made and oriented evolution 
implies an intelligent tracking of the student’s actions. In this respect, we might say that this kind of 
activity allows either the student to leam significantly or the teacher to keep the process under control. 

The Effect Of Advisement & Mode Of Instruction On Transfer, Advisor Use, And 

Attitude Toward Mathematics Using A Computer-Based Simulation Game 

Rick Van Eck, University of Memphis, USA 

This study examined the use of a computer-based mathematics simulation game with differing forms 
of advisement on transfer of mathematics skills, and attitude toward instruction. A game was 
developed using the principles of anchored instruction and piloted on middle school students in a gulf 




coast city. The independent variables were context of advisement and mode of instruction. The 
dependent variables were performance on an authentic transfer task and attitude towards mathematics. 
Preliminary analysis of the data indicate that the game was more effective than the computerized word 
problems. Analysis of gender, competition, and other variables are ongoing. 

Web-Based Implementation of the Little Man Computer 

Joaquin Vila, Illinois State University, USA; Barbara Beccue, Illinois State University, 

USA 

This paper describes the implementation of a well-known paradigm to depict the architecture and 
operations of a computer. The model, originally introduced by Dr. Stuart Madnick at MIT, is called 
the Little Man Computer (LMC). This simplistic metaphor is an effective method to introduce students 
to the workings of a computer. The LMC uses familiar objects and actions to represent computer 
components and operations. The "Little Man" visibly interprets and performs all the assigned tasks 
that are equivalent to the fetch and execute cycles in a traditional CPU. The LMC model uses a small 
instruction set that lets students write simple programs in code which resembles that of low-level 
languages. The LMC simulation was implemented in Java and operates in two modes, edit and 
execute. This application has proven to be very useful for teaching the Von Neumann architecture. 
Computer-Based Interactive Math Courses - The Guam Experience 
Yu-mei Wang, College of Education, University of Guam, U.S.A; Carl Swanson, College 
of Arts and Science, University of Guam, U.S.A 

The island of Guam is a U.S. unincorporated territory in the Western Pacific Rim. Guam is the largest 
and most heavily inhabited of the Marianas Islands with a population of 146,000. With 85% to 90% of 
college students forced to take remedial math, clearly, students in this region are mathematically 
challenged. To counter this problem, the Guam Community College introduced interactive multimedia 
computer-based learning system into their math courses. This study presents a survey result regarding 
students' attitudes towards interactive computer based math course. The sample for the study was the 
students enrolled in computer-based math courses at the level of ranging from Basic Math to 
Precalculus. Data collection spanned two semesters in 1999. Sixty-nine students participated in the 
study. Data analysis shows that students were overwhelmingly positive towards computer-based 
interactive math courses and interactive multimedia learning system. 

Knowledge Retention Following Problem-Solving Versus Information Gathering 
Jeanne Weidner, University of California at Berkeley, USA; Michael Ranney, University 
of California at Berkeley, USA 

This study investigated the retention of concepts and knowledge organizations six months after an 
initial phase during which subject pairs used computer technology to support two divergent 
instructional goals: (a) the solving of a clinical problem versus (b) gathering factual information to 
answer direct questions. After the intervention, the information gathering activity yielded significantly 
higher performance on the outcome measures (e.g., gain scores, post-tests and PFNET correlations) 
compared to the problem solving activity. However, this advantage disappeared upon delayed testing 
six months later, as the information gathering context yielded significant declines on all measures, 
while there were no such declines regarding the problem solving context. In addition, heterogenous 
academic pairs and homogenous gender pairs exhibited superior performance on initial testing, a 
finding that persisted to some degree upon delayed testing. 

Experiences in teaching an asynchronous web-enabled course to a diverse 
student 

Chris Wild, Old Dominion University, USA 

This paper describes a transition course in the C++ programming language aimed at transfer students 
and students with associate's degrees who wish to obtain an undergraduate or graduate degree in 
Computer Science. Because of the diversity of background of students entering the university, an 
adaptive web-enabled presentation of material was chosen. The instructor defines a course of study 
that links educational objectives to course material stored in a database and indexed by subject matter, 
media type, difficulty level and background. A given subject area may be covered by several 
explanations each appealing to a different level of prior experience, preferred mode of delivery, 
background and previous retrievals in the data base. Experience to date has shown there is a need to 
support a diverse student population. Of the 19 students taking this course, only 1 or 2 could be 
considered "traditional" students. 



Improving Instruction and Reducing Costs with a Web-based Learning 
Environment 

Beverly Woolf, University of Massachusetts/Amherst; David Hart, University of 
Massachusetts/Amherst; Roberta Day, University of Massachusetts/Amherst; Beatrice 
Botch, University of Massavchusetts/Amherst; William Vining, University of 
Massachusetts/Amherst 

An electronic learning environment manages homework assignments for more than 3,000 students in 
large enrollment courses at the University of Massachusetts at Amherst. Originally developed to fulfill 
a critical need in the Chemistry Department, the system has been so successful that it has been 
expanded to other departments and supports new, interactive forms of learning over the World Wide 
Web. Careful and thorough evaluation has been an integral part of the system’s development, which 
has now been adopted by ten departments and seven other institutions. We report here on the costs and 
benefits of using the basic system and on significant increases in student performance. 

Creating microworlds for exploration of mathematical concepts 

Yelland Nicola, Queensland Uni of Technology, Australia 

This paper describes the strategies and interactions of pairs of children (average age 7 years 4 months) 
while they worked on novel tasks in a computer microworld embedded within a mathematics 
curriculum. The curriculum encouraged the active exploration of ideas in both on and off computer 
tasks, which complemented each other. Observations of the children supported the notion that the 
active construction of knowledge in a computer supported collaborative learning context, enabled the 
children to engage with powerful ideas and use metastrategic strategies. Further, their spontaneous 
comments and persistence with tasks indicated a high level of interest and enthusiasm for the tasks. 

Making Sense of Science: The University of Iowa Science Information Literacy 
Initiative 

Karen Zimmerman, University of Iowa, USA; Barbara Dewey, University of Iowa, USA 
The University Libraries is in the process of developing a new initiative in partnership with faculty to 
integrate acquisition of information literacy skills into the fabric of the undergraduate science and 
technology curriculum. Called the University of Iowa Science Information Literacy Initiative, the 
project’s primary goal is to ensure that UI undergraduate science and technology majors develop 
effective information seeking and analysis skills in science and technology for use during their 
academic and professional careers. 



Synergy Education Press: Tools for Teachers’ Professional Development 



Jeffrey Horvath, Synergy Education Press, Inc., USA 
Richard Lehrer, University of Wisconsin-Madison, USA 
Matthew Koehler, Michigan State University, USA 
Anthony Petrosino, University of Texas-Austin, USA; , , 



Synergy Education Press, Inc. is a small company whose aim is to provide high-quality research-based teacher 
professional development materials for elementary mathematics and science educators. We will provide packages 
of multimedia and text-based products to help elementary math and science teachers develop deeper 
understandings of how children think about core math and science ideas (e.g., measurement, spatial reasoning, or 
inquiry-based science) and how to go about teaching these powerful ideas to their students. We differ from other 
companies in that we are not developing software or curriculum materials to be used by students, per se, nor will 
we explicitly help teachers learn how to use technology in their classrooms. Rather, we will use technology to help 
teachers learn how to be better teachers. Our products are intended for pre- and in-service teachers, home-school 
teachers, teacher education programs, and anyone interested in learning how to be a better teacher of math and 
science to young children. 

Three factors have converged in recent years to create a new opportunity to provide teacher professional 
development solutions. First, based on research done by many of the nation’s leading experts on children’s math 
and science learning (including Synergy’s founders), we now understand that young children can and do begin 
reasoning about powerful mathematical and scientific ideas that had, until recently, been reserved for later grades 
(Lehrer, et. al., 1998). For example, the National Council for Teachers of Mathematics’ new Standards 2000 
project (1999) calls for children in the elementary grades to be taught five key content areas (Number and 
Operation; Patterns, Functions, and Algebra; Geometry and Spatial Sense; Measurement; and Data Analysis, 
Statistics, and Probability) as well as five key mathematical processes (Problem Solving; Reasoning and Proof; 
Communication; Connections; and Representation). Many educators, unfortunately, do not understand these topics 
in enough detail to teach them to children. Today’s educators need to understand these topics, have a sense for 
how children think about them, and know how to successfully teach these ideas to children. 

The second factor affecting this new opportunity for the development of teacher professional development 
materials has been the recent push to raise the standards to which we should hold teachers professionally 
accountable. As the President argued in his 1997 State of The Union Address (1997), in order for our educational 
system to work, we need the best teachers. To have the best teachers, we must hold them to higher standards in 
their understanding of children’s thinking and in their own teaching abilities. In order to improve the overall 
quality of our teaching force, national teaching standards such as those of the National Board for Professional 
Teaching Standards (1999) have argued for a shift away from traditional recitation-based methods of teacher 
education and toward a more practice-based way of helping teacher’s develop their professional skills. In other 
words, prospective teachers need to spend less time listening to general methods for how they should teach and 
spend more time exploring the nature of teaching in practice in depth. 

The final factor affecting this new opportunity for the development of teacher professional development 
materials has been technological improvements that have made it possible to realize educational opportunities 
which have, until recently, not been possible. As most recent research has argued, the best way to help teachers 
understand what it means to teach in a real classroom is to allow them to become immersed in the culture of that 
classroom (Lampert & Ball, 1998). However, depositing a prospective teacher in an existing classroom is not an 
ideal solution - things go by too quickly for novices to reflect and appreciate. Recent advances in multimedia 
technologies have made it possible, however, to bring well-crafted versions of the classroom to prospective 
teachers. Advances in digital video technologies as well as hypermedia techniques have made it possible for 
teacher educators to represent the classroom and structure that representation in ways that allow prospective 
teachers the opportunity to explore teaching and learning in practice. 

The convergence of these three factors has created a new niche for high-quality, research-based, 
hypermedia-enhanced teacher professional development. Synergy Education Press is uniquely qualified to provide 
solutions to these new market needs. Synergy’s founders have a unique blend of research and practical experience 



which enables the company to provide high quality professional development packages in this new arena. We have 
decades of combined research on children’s thinking. We have spent years in real classrooms helping teachers 
develop their skills in teaching these ideas to children. We have years of teaching experience ourselves. Finally, 
we have developed multimedia and text-based teacher professional development products for elementary math and 
science that have proven successful (e.g., Horvath, 1998; Koehler & Lehrer, 1998; Lehrer & Horvath, 1998). 

Over the next year, we will be completing development of our first three products on measurement, 
geometry and spatial sense, and inquiry-based science. Each of our products will be comprised of a core video- 
intensive, case-based multimedia tool and an accompanying text. We have prototyped the first of these 
(HyperMeasure) and proven that it has significantly improved teachers knowledge of how to teach measurement to 
elementary-aged children after only four hours of interaction with the hypermedia system (Horvath, 1998). 

HyperMeasure has several features which make it a uniquely powerful teacher professional development 
tool. It elaborates a theory of children’s developing thinking about the domain (Lehrer, et. al, 1998) . It provides 
hours of carefully selected, structured, and annotated video from classrooms showing real teachers teaching 
measure to their students. And, HyperMeasure puts all of this together into a comprehensive hypermedia 
application whose design is based on a series of foundational principles for the development of case-based 
hypermedia educational products (Koehler, in preparation; Koehler 8c Lehrer, 1998). HyperMeasure is designed for 
educators with the needs of educators in mind. For example, since most educators are relatively new to 
hypermedia applications, our products are designed with navigational and structural aids to support these less- 
experienced users. The HyperMeasure hypermedia application is accompanied by a text-based teacher manual 
which elaborates on some of the ideas in the application as well as provides a number of classroom curriculum 
ideas. 

In summary, Synergy Education Press, Inc. is developing professional development solutions for today’s 
educators. With Synergy’s help, teachers will learn how to teach today’s students the mathematics and science 
they will need for the future. 
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Abstract. This paper addresses three issues critical in the development of high-quality distance 
education courses in mathematics, science, and engineering: Creating stakeholder partnerships; 
reforming the content of mathematics and science education; and developing powerful, adaptable 
WWW-based instructional delivery systems. As each issue is discussed, recommendations are 
made for engaging interested parties in government, education, and the private sector in a search 
for solutions. 



Introduction 

Contemporary culture is continuously reshaped by the power of new ideas. In particular, economic growth 
and development are driven, more and more, by commercial applications of new technologies. For those of us 
accustomed to life in the technological "fast lane", this is a time of unprecedented opportunity. For many others, 
however, this is a time of crisis. For instance, while there are currently over 44 million host computers on the 
Internet and an estimated 150 million users, only half of the population of Earth has ever made a telephone call. 
While the technologically literate entertain multiple job offers, other workers worry about corporate downsizing and 
pink slips. And third world countries worry about losing their hard-won economic progress and political standing as 
the emerging global marketplace redefines the value of labor, location, and other resources. 

In this context, convenient access to high quality, life-long education is a critical strategic factor in our 
individual and collective responses to the challenges posed by shifts in our cultural, economic, and political 
environments. Educated individuals and nations are more adaptable and therefore more competitive. Consequently, 
governments are under pressure to increase access to life-long learning for all their citizens. A nearly universal hope 
is that the Internet will play a major role in facilitating the development and delivery of educational services to 
people throughout their lives. Indeed, it appears that "The people of the world will not be satisfied until the Internet 
is "in every home, in every business, in every school, in every town and every country on the Globe, available 
without limitation, at any time and in every language (Cerf, 1999)." 

Realizing the goal of universal life-long learning will take more than clever corporate planning and political 
strategy, however. Nothing less than our collective best efforts will be adequate to the challenge. This paper briefly 
examines three issues related to the development and delivery of distance education courses in mathematics, science, 
and engineering. The issues are: 

1. Partnership. The stakeholders in distance education from government, education, and the private sector 
rarely meet to discuss mutual interests, barely understand one another’s goals and capabilities, and have 
little grasp of what might be accomplished through cooperation. Until these stakeholders forge productive 
partnerships, fundamental problems of access, affordability, and sustainability cannot be solved in a 
systemic manner. 

2. Content. Although a technologically literate workforce and electorate is of increasing value worldwide, 
student enrollment in science, mathematics, and engineering courses in many countries is flat or declining. 
Until the content of mathematics, science, and engineering education is more meaningful to students of all 
ages, enrollments in mathematics, science, and engineering courses and programs will not keep pace with 
workforce demands. 

3. Delivery. Mathematics, science, and engineering make extensive use of textual, graphical, and symbolic 
notations not generally supported by current WWW-based browsers and conferencing tools. Furthermore, 
application sharing across the Internet is often difficult and expensive. Until the tools available to distance 
education match the tools available in conventional classrooms and laboratories, degrees earned via 
distance will be regarded as of lesser value than degrees earned in residence at the same universities. 



Partnership 



Distance education needs powerful, affordable, adaptable course development and delivery systems that 
make intelligent use of current technologies and human resources without limiting future options. To create such 
systems, we need powerful partnerships involving government, education, and the private sector. Unfortunately, the 
stakeholders in distance education rarely meet to discuss mutual interests, barely understand one another’s goals and 
capabilities, and have little grasp of what might be accomplished through cooperation. For instance, program 
developers rarely meet with representatives of government or the private sector to discuss their interests, concerns, 
and needs. If meetings of this sort did occur regularly, I suspect that we might discover a pattern of differentiated 
interests and concerns something like that found in Figure 1. 
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Figure 1: Differentiated Interests 

The following hypothetical exchanges illustrate the differentiated interests illustrated in Figure 1: 



1 . Program Designer "Are you going to accredit my program?” [Accredit] 

Government Worker "Is it effective?" [Effective] 

2. Program Designer "Are you going to approve my course." [Approve] 

Education "How does it's quality compare to on-campus courses? [Quality] 

3. Private Sector "Will the public pay for this service?" [Value] 

Program Designer "If it’s good enough. Will you invest in its development?" [Investment] 



Discussions of this sort must take place before stakeholders can develop a shared vision and meaningful 
partnerships. For that to take place, a collaborative model is needed for creating, structuring, and sustaining such 
partnerships. While a wide variety of collaborative models exist, it is unclear precisely which models are best suited 
to the sort of partnerships called for in this paper and to what extent potential partners in government, education, and 
the private sector will support the use of various models. Therefore the following recommendation is offered for 
consideration by representatives of government, education, and the private sector interested in the theoretical and 
practical aspects of creating productive partnerships for distance education. 

Recommendation 1. A series of regional meetings involving representatives of government, education, and the 
private sector ... 

• Organized and conducted by a working group of mathematicians, scientists, engineers, educators, government 
officials, and private sector leadership appointed by the National Research Council; 

• To present information and take testimony on proposed collaborative models and partnerships; and 

• Prepare a white paper identifying stakeholder interests and concerns, successful collaborative models, and 
credible potential partnerships. 



Content 



If science is a well-defined process for discovering the natural world, and engineering is a well-defined 
process for adapting the natural world, and mathematics is a well-defined process for abstracting quantitative & 
spatial relationships suggested by the natural world, why do mathematics and science education so often focus on 
the products of science rather than the processes of science? Shouldn't mathematics and science education value 
mastery of the scientific method over retention of scientific knowledge? Because scientific knowledge doubles 
every 1 8 months, it will undergo a 2 8 = 256-fold increase during any 12 year period, the span of a child’s elementary 
and secondary education. How should we decide which sliver of that vast knowledge domain to teach? Do the 
publishers of traditional textbooks really know the answer to that question? 

Since science is a process for creating new knowledge, learning to participate in that process is the essence 
of becoming a scientist. If students learned that lesson, they would have some idea of what scientists do for a living. 
Unfortunately, many students believe that the day-to-day lives of scientists have more to do with remembering 
established knowledge than discovering, adapting, and abstracting new knowledge. Where did they learn that 
lesson? They learned it in school, of course. It is no wonder, that by junior high school (“The Graveyard of Great 
Ambitions”), most students have dismissed science as a career path. 

One of the principal challenges faced by reformers in mathematics and science education is that of 
presenting science and mathematics content in ways that engage the student in the scientific process, recognize and 
reward scientific thinking, and make meaningful connections to the real world. M/SET participants are particularly 
interested in how information technologies may be used to reawaken student interest in mathematics and the 
sciences, revitalize mathematics and science instruction, and attract more students to careers in mathematics, 
science, engineering, and technology. Since there is little evidence that using information technologies to present 
scientific facts results in greater understanding or retention than conventional means, most researchers' and 
practitioners' efforts focus on the development and use of modeling, simulation, data management and analysis 
tools, and communication tools that facilitate the formulation of questions, conjectures, and hypotheses, the design 
of experiments and models, the interpretation of results, and the presentation of findings. Figure 2 illustrates this 
differentiated use of technologies. 
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Figure 2: Differentiated Use of Technologies 



Figure 3 presents a conceptual metaphor for discussing the benefits of information technologies at different 
levels of education. The fundamental concept presented is that, as one moves from elementary school to high school 
to university, the range of questions considered becomes more and more complex and includes a high and higher 
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proportion of questions that are not decidable. For instance, most of the science questions considered by elementary 
school students are answerable by direct observation. "Do some rocks float? Do pure water and salt water boil at 
the same temperature?" And so on. Few questions of an undecidable nature are entertained at that level. By 
contrast, by the time one enters graduate school, it becomes clear that a great many interesting questions are not 
decidable for lack of theoretical knowledge, scientific data, and other reasons. However, as high performance 
computing has shown repeatedly, some previously intractable questions may be investigated and answered using 
models, simulations, and other information technologies. 

The purpose of Figure 3 is to convey the idea that information technologies play an important role in the 
investigation of problems for which no analytic solutions exist. Having a workforce capable of solving such 
problems is a critical factor in determining the economic competitiveness of both corporations and nations. 
Furthermore, having a scientifically literate electorate facilitates informed public debate on matters with scientific 
content, such as public health, national defense, the federal government’s role in basic research, and the value of 
information technologies in education. 
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Figure 3: Benefits of Information Technologies 



Recommendation 2. A WWW site featuring exemplary uses of information technologies in mathematics, science, 
and engineering education . . . 

• Commissioned and managed by AACE; 

• For demonstrating how the use of information technologies, including distance education, enhance student 
achievement and attitudes toward mathematics, science, and engineering; 

• Disseminated through authorized presentations at regional and national NCTM, NSTA, and other meetings in 
subsequent years and via a distance education course developed specifically for that purpose. 



Delivery 

In mathematics, science, and engineering, specialized symbolic notations and graphical elements are used 
to represent concepts, relationships, processes, problems, solutions, and other information. Unfortunately, current 
WWW browsers offer little or no support for specialized notations and graphical elements. Consequently, 
mathematicians, scientists, and engineers normally convert nonstandard elements into GIF files for display in their 
HTML pages. The limitations of this approach arise because the contents of GIFs may not be searched, indexed, or 
copied into other applications for reuse. For instance, a complex mathematical formula may not be copied from an 
HTML page and pasted into a mathematical application for evaluation. Scientific papers may not be searched for 
use of a particular mathematical representation. And so on. 
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Significant progress toward a solution to this problem is being made by the World Wide Web Consortium 
(W3C, 1999). W3C is developing a WWW-based mathematics mark-up language, MathML. When implemented 
in the next generation of WWW browsers, MathML will facilitate the encoding of mathematical material suitable for 
teaching and scientific communication at all levels. It will also facilitate conversion to and from other mathematical 
formats, both presentational and semantic. For instance. Figure 4 shows a MathML generated matrix equation. 
Each object in the equation is a searchable, active HTML element and may be used as a link to other HTML objects 
and pages. In this case, the variable e is highlighted when the mouse passes over it. 
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Figure 4: MathML Generated Matrix Equation 

Output formats supported by MathML will include graphical displays, speech synthesizers, input to 
computer algebra systems, math layout languages such as TeX, plain text displays, and a variety of print media, 
including Braille. Recently, Geometry Technologies, Inc. (1999) and ICESoft AS (1999) jointly announced the 
release of a WWW browser with full native MathML support, ICE Browser. This collaboration involves Geometry 
Technologies’ WebEQ editing and display tools and ICESoft AS' Java-enabled WWW browser. 

A related problem is that of application sharing over the WWW. In application sharing, two or more users 
have joint control over an application running on only one of their computers. In teaching remote students the use of 
specialized applications such as modeling and simulation tools, instructors need the same freedom of demonstration 
enjoyed by teachers and students seated beside one another at a single computer terminal or by a teacher 
demonstrating an application to a class using a projection system. While a number of products offer partial solutions 
to this problem, no comprehensive approach exists that overcomes all of the cross-platform issues, affordability 
issues, limits on the number of simultaneous users, and other problems. 

Readers interested in experimenting with application sharing are referred to NetMeeting 3.0 , a free 
download from MicroSoft (1999). Two or more remote users may simultaneously share a single application using 
this tool. All users must have NetMeeting running in a Windows environment on networked computers. If the 
network connection is fast, both the audio and video connections are excellent. If the network connection is slow, 
the white board should be used for verbal communication rather than audio. One shortcoming is that animations do 
not share well, as the refreshing of the remote users screen becomes overwhelming. On the other hand, NetMeeting 
provides a simple means for sharing many other sorts of applications. 

For organizing course content, managing communications and student accounts, and other standard issues 
in distance learning, I prefer WebCT (1999a). This integrated suite of tools has been tested on a number of university 
campuses with thousands of students (WebCT, 1999b). Interested persons may examine demonstration courses or 
create their own temporary course for free (WebCT, 1999c). WebCT itself is a free download and licensing fees per 
student are remarkably low, approximately $2 per student per course. 

Using tools such as WebCT , WebEQ , and NetMeeting , significant progress is possible in the design, 
development, and delivery of low-cost WWW-based mathematics, science, and engineering courses and programs. 
Because the flow of information and ideas in such courses may be recorded for later use, they provide a powerful 
research environment in which to study teaching and learning in distance education. For instance, if distance 
education students are assigned to small groups, one may ask whether 

• Synchronous (chats) or asynchronous (messages) are more productive environments for addressing various 
tasks 

• Performance on group tasks is related to performance on individual tasks 

• Different patterns of communication are more productive when negotiating meaning, formulating questions and 
answers, presenting findings, and so on 

• Males approach group communication differently than females 

• Patterns of communication evolve during the course or remain stable 



Recommendation 3 . A monograph on delivery systems in distance education for mathematics, science, and 
engineering 

• Commissioned by AACE; 

• Focused on the identification of needs, evolving technologies, and research opportunities. 



Conclusion 

This paper has examined three critical issues in the development of distance education courses and 
programs for mathematics, science, and engineering: Partnerships, content, and delivery. Until powerful 
partnerships are forged involving the principal stakeholders in distance education, systemic solutions to current 
problems and limitations cannot be developed. A national effort is needed to focus the attention of government, 
education, and the private sector on this issue. Only a call for participation for the highest level will induce these 
stakeholders to take the first step in the creation of such partnerships. For that reason, I believe the National 
Research Council should undertake this responsibility. 

With regard to reform of mathematics, science, and engineering education, I believe that AACE should 
lead in an effort to define our goals with respect the use of information technologies. In this, we should seek the 
assistance of NCTM, NSTA, AMS, AAAS, and other interested organizations. But I think AACE is the natural 
locus of expertise to structure the inquiry in a manner meaningful to end users in the educational community. 

Finally, concerning the development of a clear set of goals and needs relative to the delivery of distance 
education, I believe that AACE is the natural organizing agency. Working with the W3C, the Internet Society, 
IEEE, the high performance computing community, and other interested organizations, AACE can structure the 
investigation in a manner meaningful to the distance education community. 

If we find a way to do these things, we, as educational researchers and teachers, will have a hand in the 
development of partnerships, curricula, and delivery systems that will define our professional opportunities for years 
to come. If we do not take the leadership in this endeavor, somebody else will who has other goals, other needs, 
other motivations. This is a time for boldness. Do we have a choice? 
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Abstract. The Internet provides an excellent resource for students, teachers, and others to explore 
current science. In particular, it provides a vehicle for developing technology-rich courses that 
provide students with great autonomy in selecting and carrying out learning. Course development 
is a very complex endeavor linking subject matter, developmentally appropriate learning processes, 
available resources, technology, time, and assessment techniques. Less obvious, but of equal 
importance, is the interaction of teacher beliefs and design decisions. Development proceeds in a 
context of implicit and explicit beliefs about the nature of science, learning, and curriculum. 
Astronomy provided the context for illustrating the ways that one teacher’s beliefs about science, 
learning, and curriculum were embedded in the development of a web-based high school course. 



Technologies are being introduced into schools at ever-increasing rates. Collectively, they have the potential to 
transform learning in ways that parallel the changes brought about by the printing press. However, teachers’ 
existing beliefs and models of teaching are often inconsistent with the opportunities afforded by those technologies 
(NCATE, 1998). Making successful use of new technologies requires that teaching - and thus learning - practices be 
reexamined in light of research in the cognitive sciences and research on professional knowledge development if the 
potential is to be realized. In particular, blending the information-processing capacities of new technologies with 
current constructivist views yields a guide for establishing rich learning experiences that foster meaningful 
understanding (Perkins, 1992). Further, practices for preparing teachers need to change. Current teacher education 
practices tend to socialize beginners into a world of contradictions: Effective practices are described but not 
modeled; technologies are plentiful in one setting but absent in another; innovation is encouraged but risks are not 
allowed. 

In this paper, we examine the ways that one teacher’s beliefs about subject matter, learning, and curriculum were 
evidenced in the design and implementation of a technology-rich high school science course. The teacher, a former 
systems and NASA aerospace engineer with twenty years classroom teaching experience, is a recognized leader in 
science education in the state of Wisconsin. He serves as a technology coordinator and staff developer in his school 
district and works with the University of Wisconsin - Eau Claire science teacher education program. 

Web-based Astronomy as the Context for Exploring Beliefs about Science, Learning, and Curriculum 

The Internet provides an excellent resource for students, teachers, and others to explore current science. It is also a 
platform for learning where students can be guided through a process of learning in ways more tailored to their 
learning styles and interests. Jim Adams, a science teacher at Chetek High School, Chetek Wisconsin, is exploring 
the use of the Internet as a learning tool. Mr. Adams designed a web-based astronomy course designed to be 
completed independently by high school students. The students have all the resources necessary to complete the 
course available through a class Internet site. Students can access descriptions of class expectations, learning tasks, 
assessments, suggested schedules, and links to astronomy sites that will help them with various tasks. The course 
has operated for three 9-week terms and was featured on Wisconsin Public Television’s Teaching through 
Technology program. The Internet address for the site is 



The development of an astronomy course for high school students is a very complex endeavor linking subject 
matter, developmentally appropriate learning processes, available resources, technology, time, and assessment 



Introduction 



www.win.bright.net/Hcadams (click on “Astronomy at Chetek High School”) 



techniques. The current astronomy course includes eleven tasks ranging from constructing a definition of astronomy 
to understanding the structure and scale of the solar system to illustrating the history and mythology of Astronomy 
to completing an independent project. Students complete the tasks - structured as projects - in any order they wish 
using support materials from the Internet, classroom, and the teacher, as they deem appropriate. Each task is 
scaffolded with introductory material, hints for getting started, and assessment criteria. In addition to the astronomy 
learning resources, the course web site provides expectations for classroom conduct, suggestions for managing time 
and effort, and grading information. 

A typical day in Mr. Adams’ class might find a group of students using the web sites embedded in the course to 
develop a comparison of astronomy while others are chatting about the images found at a NASA site. Still other 
students are discussing a project with Mr. Adams as an assessment of ideas about newly discovered objects in the 
solar system. Some students may not be visibly doing anything related to the course goals - it is their responsibility 
to manage time and effort (with occasional gentle guidance from the teacher...) 



The Reflective Process 

Mr. Adams serves as a supervising teacher and staff developer as well as a classroom teacher. Although our primary 
questions concerned the ways that the Chetek Astronomy course reflected Mr. Adams’s beliefs about science, 
learning, and curriculum, we were also interested in the ways that examining course development might help 
teachers more carefully reflect on their own developing pedagogical knowledge (Shulman, 1986). We used the 
course materials and design as a setting for probing the underlying beliefs held by Mr. Adams and how those beliefs 
were evidenced - or not - in the experiences and materials available to students. We worked with the following 
guiding questions: 

“What are your fundamental beliefs about science?” 

“How does your own background in science and engineering influence what your believe about teaching 



“How is your belief system reflected in the Astronomy class you designed?” 

“How could reflecting on your belief system help pre-service teachers and methods teachers?” 

These were deep questions and required considerable thought and a high level of honesty to answer. 
Examining ones beliefs about science and science teaching is like getting into the brain and viewing the past. Since 
the course already existed, we “worked backwards” using the course materials and tasks as evidence of Mr. Adams’s 
beliefs (thus the reference to George Lucas in the title). We were guided by Schon’s (1983) notions of knowledge- 
in-action and “design as a reflective conversation with the situation.” In this case, the situation was the structure and 
function of the web-based astronomy course. 

The reflective process included several cycles of posing assertions about science, learning, and curriculum followed 
by examination of the course materials for ways that the assertions were - or were not evidenced in the materials. 

We shared assertions via email, regular meetings, and impromptu discussions. As the reflective process unfolded, 
we elected to “go public” and developed two regional presentations about the course and the underlying beliefs 
embedded in it. These too served as vehicles for extending the reflective process and making implicit ideas more 
public and accessible. We developed outlines and Power Point presentations that acted as vehicles for classifying 
and synthesizing belief statements into groups. The presentations themselves thus became intermediate evidence. 

As new groupings emerged, we reexamined the course materials to identify points where students’ learning 



Mr. Adams’ Beliefs 

The conversations and analysis of course materials resulted in a clustered set of assertions that were organized into 
the following categories: (a) The nature of science, (b) Science as a vehicle for other learning, (c) What is science 
learning, and (e) Whose science curriculum is important. Each set of assertions is summarized below. 




DO 



The Nature of Science 



Mr. Adams’ beliefs about the nature of science have been a part of his belief system since early childhood. 

However, it is mainly since becoming a teacher and teaching science that he has been able to think deeply about and 
express them in terms of science education. 

Science is a part of our everyday life . Science is all around us. It is difficult to imagine living is this world without 
observing, experiencing, or using science principles in some way. The air we breath, vehicles we commute with, 
products we buy, the medicines we take, the entertainment we partake in, and the tools we use to be productive 
citizens all involve science in one way or another. It is difficult for me, as a teacher, to imagine anything we are 
involved with in our daily lives that does not include some form of science. 

Science integrates many disciplines . Science is an excellent vehicle for learning. It involves technical reading, 
writing, speaking, and thinking. It involves mathematics from simple math to complex calculus. It requires students 
to research information using critical thinking skills such as evaluating resources, and learning the logic of 
something. It involves historical thinking because we have learned so much from our past. It often requires students 
to construct apparatus for experiments requiring the use of shop tools. It involves literature, particularly in the form 
of science fiction. If there were an “all around” subject in which all core disciplines (math, science, social studies, 
and English) can be integrated into project oriented learning, science would be it. 

Futuristic science really interests students . If you want to catch the interest of students get them involved in what 
their future might be like. They enjoy projecting ahead and imagining what life will be like for them twenty or more 
years from now. They like to think about space travel, futuristic automobiles, trains, and boats, what life might be 
like on a different planet, or what computers might be doing for them in the distant future. Students seem to accept 
easily the challenge of projecting ahead and feeling a part of “designing” their future. 

Science can “ftook” the interest of students - if they can tinker at an early age . Often I find students, particularly 
younger students, who find a deep interest in some area of science because they have “tinkered” with it. Students 
who often go into the engineering fields do so because as a child they played with Tinker Toys, Erector Sets, Lego 
Blocks, or science kits they were given as a gift. It is even more valuable for young students if they can “play” with 
an adult with similar interests who can mentor them and enrich their interest in science. 

There is much science in the things students are “into.” Students are interested in many different things. They are 
interested in cars, tractors, animals, cooking, making clothes, music, electronic gadgets, gardening, health, and other 
things too numerous to list here. The science involved in automobiles is an example. A quick list includes the 
mechanics involved in the drive train and engine, the physics involved in transferring power from the engine to the 
pavement, the chemistry in fuels, plastics, and lubricants, the human reactions and responses to the act of driving, 
and the electronics involved in ignition systems, radios and stereos, and modem GPS (Geo-Positioning Systems). 
The key is that educators must find the interest of the learner and take advantage of it in the learning process. When 
learning is relevant to the learner, it is more likely that understanding will occur. 



Science is a Vehicle for other Learning 

Language/Communications. The study of the science of something involves a great amount of language arts and 
communications skills. When students are interested in learning about some scientific principle, object, or process, 
they readily become involved in using or learning research skills. These research skills involve library research, 
Internet research, and possibly searching for local or community resources. This research involves organization 
skills. Students leam to organize their notes, thoughts, and other information into form that helps them make sense 
out of it. Once students have collected their information and/or data, they need to communicate their findings to 
others. This is where writing and speaking skills are used. The science interest becomes the vehicle for writing and 
speaking. 

The science being studied by students should have value to someone. It may be of value to the student, the school, 
the local community, or the scientific community. When there is value, there must be communication. If the 
information is not communicated in a clear manner, there is no value to it. Written and oral communication is an 



excellent vehicle for student evaluation also. Such evaluation is performance based and authentic. It allows 
students to demonstrate their understanding of the information and concepts learned. 

Critical thinking, . Science offers students many opportunities to apply critical thinking. Through experimentation, 
research, and experience they learn to compare and contrast, consider other points of view, recognize valid and 
invalid resources, and understand the logic of things. When students examine their own beliefs about science, they 
often realize that what they believe is not always right. The science of things often defies what students believe they 
know. Some students believe that water will boil better with the burner on high and the hotter the burner the hotter 
the water in the pot. They will continue to believe this until through critical thinking and scientific experimentation 
they prove to themselves that it is not true. The Internet is a wonderful tool for students. However, it is also 
populated with WEB sites that are simply opinions. Use of the Internet offers students an excellent opportunity to 
evaluate information for its authenticity. 



Science Learning 

Students must construct their own meaning and understanding of science . Each day students experience science. 
It may be gravity, fishing and hunting, driving a car, baby sitting, or listening to music. They have their own 
concepts of how things work in the world and if their concept is incorrect, it will remain incorrect until they can 
construct their own knowledge and change their beliefs based upon scientific principles. 



Whose Science Curriculum is Important? 

Much of the science we teach is too specific and not relevant Science curriculum needs to be based upon student’s 
interests. So much of what is taught in secondary curriculums is so specific and detailed that students loose interest 
very easily. They need more choice in what they learn. Our curriculum might not be so fixed and rigid. Our 
students learn more like a person using the Internet. The idea of links which allow the Internet user to move about 
within a subject area at will is more in tune to how we all learn. Learning is not always sequential. 

Much of the “ pure sciences ” are uninteresting to many students . Many students have little or no interest in the 
“pure sciences” we are teaching. They see little or no connection to what we are asking them to learn. We need to 
connect the sciences to some of the mysterious things students wonder about. They are fascinated with things like 
traveling at the speed of light, life on other planets, unexplained things, magic, sports, etc. Students also like to 
tackle health issues as long as we educators are not preaching to them - they would rather find out for themselves. 
The type of science they want to do is constructing models, raising gardens, doing nature photography, observing 
wildlife, or experiencing physics in an automobile. In short, they will learn almost any science if they can relate it to 
their experiences. In short, we need to concern ourselves with the question “What science do STUDENTS want to 



Discussion 

The descriptions above highlight essential aspects of Mr. Adams’ beliefs about science, learning, and curriculum. 
Developing the language to describe the underlying thoughts provided him with a new way of analyzing his own 
teaching and other professional activities: 

“The idea of reflecting on my own teaching and beliefs about science and the teaching of science 
opened my eyes to why it is so difficult to reform the current education system. Most teachers 
teach the way they were taught. Because of such reflection, I can say that I began to understand 
how I learned for understanding. This helped me change the process I use with my students. The 
reflective process is time consuming and I feel is helped by being able to “talk it though” with 
another teacher or professor. The most difficult aspect is finding time to create new and relevant 
learning environments for learners.” 



Thus, we were successful in achieving the first goal - describing ways that Mr. Adams’s beliefs were evidenced in 
the design of the astronomy course. Teaching future teachers to help learners understand the interactions among 
their ideas about science, curriculum, and learning is a challenge. Teachers need to know how science is learned, 
how to integrate subject matter, how to work with veteran teachers, how to work with leadership groups, and as 
mentioned above how to use technology. They have little time to think about or dialog about new ways to help 
students learn. Learning, to many, is a result of studying and passing a test on certain knowledge imparted from the 
teacher to the student (in a rather passive manner); not a result of the learner constructing his/her knowledge from 
experience. That is their belief system. 

Examining the ways that an experienced teacher draws on technology to create rich learning environments has 
significant implications for preservice teacher education. One example lies in the use of tools to establish structure 
with Internet resources. When teachers become familiar with HTML languages, web page design tools, and 
strategies for organizing potential course materials, they are empowered to set up new ways of learning for their 
students. The process (and conceptualization) of lesson design may need to shift radically to incorporate such tools 
as everyday parts of the beginning teacher’s professional repertoire. 

Science content in teacher education programs may have to change. With the advent of the Internet, computer 
simulations (mathematical and experimental), CD-ROM’s, and other multimedia systems, teachers need to become 
familiar with such tools so they can be used in the learning process - both the teachers learning process and the 
student’s learning process. Common practice in teacher education programs should include modeling with computer 
spreadsheets, using various science software programs, making tables with word processors, and graphing equations 
with software. It is easy for one to see how math, technical communications, and social studies are integrated in a 
relevant way through science when technology is used as a tool for learning. Teachers will, in all likelihood, be 
changing their roles in the learning process as students become more familiar with technology. 

Perhaps one of the most valuable things ALL science teachers can learn is how to think about their own teaching. 

The reflective process is an excellent way to improve one’s teaching and beliefs about science and teaching science. 
Without a continuous reflective process teaching will become stagnant. The process is like doing action research 
inside your brain. The most difficult aspect is finding time to create new and relevant learning environments based 
upon the reflection process. That’s another issue in the road to educational reform! 
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Abstract: The Earth and Space Science Technological Education Project 
(ESSTEP) is a professional development program for secondary and college 
faculty. This program addresses the growing need to provide students with 
the critical academic and personal skills necessary for successful technical 
careers in the earth, space and environmental sciences. ESSTEP has 
provided educators with the skills to infuse global positioning system, 
geographic information systems and image processing into their classrooms. 
As a result of their ESSTEP experiences, educators are enhancing student 
learning, promoting science and technology careers, and catalyzing the 
development of new courses and materials. 



Introduction 

The Earth and Space Science Technological Education Project (ESSTEP) is a professional 
development program for secondary and college faculty. This program, which began in 1997, 
was developed to address the growing need to provide students with the critical academic and 
personal skills necessary for successful technical careers in the earth, space and environmental 
sciences. ESSTEP has provided educators with the skills to infuse global positioning system, 
geographic information systems, and image processing into their classrooms. As a result of their 
ESSTEP experiences, educators are enhancing student learning, promoting science and 
technology careers, and catalyzing the development of new courses and materials. 

The ESSTEP professional development program is a collaborative between the Geological 
Society of America, Cypress College and the Space Science Institute, with support from the 
National Science Foundation. ESSTEP was designed to meet faculty needs by providing 
extended time for skills development and planning, on-going support over a two-year period, and 
substantial opportunities for peer collaboration. 

Each year two sets of cohort groups were trained at three different sites throughout the country. 
To date, the ESSTEP program has reached nearly 130 secondary and college faculty. During a 
two-week initial workshop in the first year, and a one-week follow-up workshop the second year, 
participants were exposed to 

• hands-on experience in state-of-the-art data acquisition, manipulation, and presentation 
technologies for the sciences, geography and mathematics 



• innovative strategies for using technology in classrooms and laboratories 

• improved access to a wide-variety of technology-based education resources 

• assistance in obtaining internship opportunities in earth and space science technology 
fields 

• training in implementing professional development sessions for colleagues. 

The ESSTEP program was crafted to provide faculty with the opportunity to develop their own 
technology and teaching skills to create more dynamic, learner-centered curricula. Back in the 
classroom, ESSTEP faculty involve students in hands-on investigations of science, interwoven 
with appropriate technology tools in both the field and the lab. In addition, the National 
Technology Education Standards, currently under development as part of the Technology for All 
Americans project, views technology education as a process for dynamic problem-solving, and 
as a means to demonstrate scientific principles. ESSTEP supports this by exploring the role 
technology can play as a tool for more effective teaching, doing and understanding science. 

A 1996 survey of university faculty and scientists in government and private industry revealed 
that a variety of skills, including communication skills, scientific content knowledge, 
mathematics, analytical thinking, and computer skills were fundamental to students’ successful 
pursuit of careers in science and technology. These skills mesh well with the National Science 
Education Standards, which apply to all sciences, as well as the Curriculum and Evaluation 
Standards for School Mathematics and the National Geography Standards. Helping educators 
develop ways to better meet these standards was central to the overall goal of this program. 



Global Positioning System (GPS) 

ESSTEP has provided participants with several levels of instruction into the appropriate use of 
GPS in a school setting. Many teachers are finding that simply just using a GSP receiver as a tool 
for locating points around their school is an excellent way to explore the concepts of latitude and 
longitude. Used in conjunction with a local USGS topographic map, participants learn how to 
mark a point in the field, then later find it on a paper map. Additionally, participants learned how 
to: 

• mark a point in the field, then later find it on a paper map 

• enter locational coordinates manually into the GPS receiver 

• create their own orienteering routes and use them in the field 

• apply a differential correction to a location to reduce its level of error 

• electronically download data from GPS receivers into a computer for post acquisition 
processing, plotting, or mapping 



Geographic Information Systems (GIS) 

Over the last decade, GIS has grown to be one of the most important tools available to city and 
land use planners. Bringing the conceptual knowledge of, and practical use of, this application to 
the field of education is critical; both because of its importance in industry and government, but 



also because it represents a very effective tool for teaching students to think critically about 
resource use and land management. 

This workshop used the application ArcView, developed by the Environmental Research 
Systems Institute (ESRI). Over a three-day period, GIS instruction focused on the following 
areas of performance: 

• scale, labeling features, map projections 

• visualizing data (changing colors, symbols, and classes of data) 

• querying (asking questions of data) 

• creating custom charts and layouts 

• locating and accessing sources of existing GIS 

• creating new data and incorporating it into existing projects. 

The primary goal of this instruction was to get the participants to the point where they could 
introduce this technology into their classrooms at an entry level of operation. That is, to enable 
students to take existing data sets and use them to answer complex questions regarding the 
relationships between spatially referenced attributes. However, some teachers were comfortable 
enough to create their own data. Usually this was accomplished by creating spatial points 
obtained through the importing of GPS collected points and linking those with some attribute 
associated with each point. 



Image Processing (IP) 

Another important part of the technology instruction for this workshop focused on image 
processing. Software for this portion of the workshop was NIH Image for the Mac, and Scion 
Image for the PC. Drawing upon an instructional package developed by the Center for Image 
Processing Education (CIPE: Tucson, A Z) the participants were given three full days of hands- 
on instruction in this area. 

The rationale for this part of the workshop was to make participants aware of what digital images 
are, how they can be manipulated, their power as visualization tools for representing data, and 
how they can be subject to a variety of analytical techniques. In addition to using the imagery 
provided for them on the CIPE workshop CD, participants also learned how to generate their 
own digital images through a variety of methods. These included the use of digital cameras, 
flatbed scanners, downloading of imagery from the world-wide web, and even the creation of 
images from text-based files of numerical data that have been arranged in a rectangular matrix. 

Participants also learned to use some of the tools of this application to: 

• scale an image to take fast and accurate measurements of distance and area 

• calibrate the density of an image (its level of brightness) to a measured value 

• make three-dimensional representations of an image 

• project multiple images in sequence as an animation 



The level of IP instruction was geared towards giving participants the basic knowledge necessary 
to introduce IP into science, math and social studies course at any secondary grade level. 
Instruction was also directed at helping all participants get to the point where they could take the 
basic principles learned and direct them to towards the creation of activities that were directly 
applicable to relevant issues within the subjects that they taught. Learning how to treat the 
application as a suite of tools that are useful for scientific inquiry, rather than as a set of "canned" 
activities, was a strong goal for the workshop participants. 



Local Implementation 

One of the most important parts of this program was the requirement that participants come as 
members of a team. Geographically proximal teams were composed of 2-5 teachers from a 
variety of science, math and social studies backgrounds from both college and pre-college 
institutions. By working together, each professional brought a unique perspective as to how the 
various technologies could be utilized in their local school situations. Team members also 
provide support for each other and access to additional local resources. 

To make sure that workshop instruction eventually resulted in enhancements in student learning, 
all workshop participants with given ample time to talk together within their teams, and to 
develop specific ideas for each team's unique local circumstances and interests. Assistance was 
provided in such areas as: 

1 . How to use specific technologies - Which applications would best suit the needs of a 
particular scientific or geographic investigation. Making sure that the specific options 
within a technology are understood operationally so as to use them effectively in the 
instructional program. 

2. Where to find or create data - Locating where useful available data may be found, 
and learning how to get data into a form that the chosen application could use. 

3. How to effectively use technology in a teaching/classroom setting - Technology in 
a classroom situation often requires modifications as to how students interact with 
each other and the teacher. Teachers may find that their questioning strategies may 
need to altered, as well as their methods of assessment. Efforts were made by 
workshop leaders to share past experiences and best practices with workshop 
participants so as to make the introduction of these technologies into the classroom as 
smooth as possible. 

One additional method to ensure that local implementation took place was to have each of the 
participants commit to returning for a follow-up week one year after their initial training. The 
requirement that each group had to share what they were able to do with technology in their 
classrooms provided a strong incentive to creative interesting and innovative projects. During 
each follow-up "reunion" we were continuously amazed with the variety of ways that the 
ESSTEP training resulted in exciting student projects that linked students to innovative ways to 
apply technological tools to their analysis and understanding of the world in which they live 
(from local to global perspectives). 



Conclusions 



Initial indications from our external evaluation reports have indicated positive impacts on student 
learning, interest and motivation for all types of students, including those with special needs. 

This finding is closely aligned with our original goals, providing support and evidence that the 
ESSTEP model is an effective means to bring change in both teaching and learning. 

A key finding of the evaluation of ESSTEP's professional development model is that it provides 
valuable skills and knowledge to faculty interested in incorporating technology into science, 
math and geography instruction. With adequate training, time and support we have shown that 
teachers are capable of adopting cutting edge technologies to a variety of classroom settings. 

This program has also demonstrated the necessary degree of flexibility to address the training 
and support for a variety of teams, each with their own unique needs. 

Thus far, the main impacts of ESSTEP are that it has: 

• deepened teachers' involvement in a variety of responsibilities and activities related to 
technology and science education at their schools and colleges 

• increased awareness and knowledge of a variety of technologies and their applications to 
earth and space science instruction 

• increased knowledge and skills in geoscience content 

• served as a catalyst for faculty developing technology-rich curriculum and implementing 
it in their classrooms 

• encouraged and supported teachers to work with administrators and others at their 
schools and colleges to upgrade equipment, purchase software, and broaden the use of 
technology in the science curriculum and other subject areas. 

• introduced faculty to resources and information on new science teaching methods. 

Specific factors which have made this program successful include: 

• Working in multigrade and interdisciplinary teams 

• Providing substantial practice and exploration time during each phase of technology 
transfer 

• Providing time for team concept building while in the group setting (with technical 
support and reinforcement) 

• Working to help teachers achieve what they want to do within the constraints of their 
own teaching situations 

• Sharing example of how the technology can be used effectively in the classroom, as 
opposed to just showing people what the technology can do 

• Continued communication and support (technical & moral) during the initial local 
implementation of technological applications 

• Creation of an extended professional support group, linked physically by the Internet, and 
emotionally by their common experience and shared ideals 

• Reporting of activities conducted at the one-year reunion 
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Abstract: Technological developments provided types of tools to be employed in teaching different subject 
matters and allowed to make some problematic subjects easier. This paper critically outlines the major trends 
of the employment of computer based learning packages and argues for environments in which the domain 
tasks can be procedural ised. The design considerations of a procedural environment, BALANCER for 
learning addition, is described, implementation studies and a small informative evaluation on the interface are 
also explained. The interface facilities of the system were found interesting and helpful, so is interpreted 
promising. The paper concludes with some suggestions for more comprehensive evaluation studies. 



Introduction 

Recent advancements in the field of information and communication technologies enabled learning environments to 
process, store, retrieve and transmit information in multi-modes as sound, text, graphics and video clips. However, a 
learning environment has to be interactive in the sense that a learner can browse and navigate through it, search for 
information, experiment knowledge patterns, investigate procedures, and reply to questions by means of input devices such 
as a mouse, keyboard or voice command system. Well-structured environments with manipulation devices also allow to 
manipulate computer representations of knowledge, to solve problems, to respond to challenging tasks and to create 
representations. Interactive environments are now able to engage students in meaningful learning activities including 
collaborative learning with others nearby or at a distance. Therefore, the facilities of computers have aroused the design 
and implementation of a variety of learning softwares. 

Early instructional software packages were in tutorial mode (Taylor, 1969) in which the material, tasks and 
feedback comments were pre-stored and the student must study under the program control. Those tutorials allowed the 
student to answer questions or undertake tasks within extremely directed styles (Akpinar and Hartley, 1996). Hence the 
introduction of even prescribed and directed programs can cause a shift towards greater learner and teacher involvement in 
instruction, even though the programs were not particularly designed to encourage to understand error and diagnostic 
feedback underpinning concepts of the domain. 

As computer technology and computational methodologies improved, artificial intelligence techniques have resulted 
in the development of tutorial software packages containing domain knowledge in a form that allows them to generate task 
materials and respond students’ different questions (O’Shea and Self, 1983). These intelligent tutoring systems (ITS) can 
therefore give greater interactive support to learners, however, they tend to be considerably specialised and have been 
implemented as proof of concept rather than as institutional packages which are employed in everyday teaching. Also, as 
Newman et al (1989) point out, ITSs, though sophisticated, are far from taking adequate account of the social context of 
learning. 

LOGO project, (Papert, 1980) deeply influenced by artificial intelligence concepts and methodologies, provides 
students with a computer language to reveal, exploit and extend their knowledge in a principled way, for example in Turtle 
Geometry. However there are contradictory research findings about the effectiveness of LOGO. For example, Harel (1990) 
reports from empirical research data that LOGO activities were helpful to the children to develop fraction knowledge and 
problem solving. On the contrary, Vasu and Tyler (1997) found that the LOGO activities were not succesful over 
developing problem solving but at developing “spatial thinking”. In practise, LOGO is seen as a collaborative activity for 
small group of children, despite the fact that the LOGO language was not designed from this perspective (Pea, 1987). 

Interactive Multi-Mode Representations and Screen Design 

Other forms of computer assisted learning receive similar criticisms. For example, computer based simulations 
involve the dynamic representations of process, incorporating to varying degrees the possibility of intervention, as 
interactivity, on the user’s part (Dowling, 1997). Simulation programs are designed to encourage investigation as students 
form and test hypothesis about the underlying model. But nevertheless, this again requires careful preparation so that 
learners have an adequate conceptual framework on which to base and modify their hypotheses (Bork, 1984) and 
simulation programs are not usually designed to deliver this support. In classroom environments the programs are often 
used by small groups of students, and as evidenced by Vanlehn (1987) that these student interactions and explanations lead 
to learning benefits. However, Hartley et al (1991) showed that unless such discourse reached the student’s causal beliefs, 
conceptual change could not be guaranteed. The evaluation studies of simulation and qualitative modelling programs 
(Draper et al, 1991) illustrated that a teacher is needed to engineer such interchanges and the designers must consider 
myriad modes of use classroom supports and the changing styles of teach ing/leaming that might occur. 

Increasing complexity of learning environments and the instructional technology allowed to design complex systems 
based upon a non-linear organization of the information within multiple formats. Visually enriching environments as 
multimedia and hypermedia are reported to have the potential to motivate learning, to improve understanding and to 
achieve the highest rates of retention (Levin, 1987). However, research (Kozma, 1991) has shown that simply providing 



multiple symbol systems for representation of subject matters, for promoting conceptual understanding of a knowledge 
domain and for enabling multi-sensory experiences does not enhance comprehension and knowledge acquisition. Empirical 
research has also demonstrated (Clark and Craik, 1992) that assumptions based on integrative effects of representational 
codes of single media on enhancing learning effectiveness fall short with regard to the conditions necessary for making the 
characteristics of external representations effective for the construction of individual mental representations. Scanlon and 
O’Shea (1988) suggesting instructional consequences from their results, concluded that instruction should be developed to 
provide constraints and to facilitate orderly moves from one inference process, representation or knowledge source to 
another. 

Interaction is the major difference between traditional instruction and computer based instruction. Incorporating 
strategies that cause the learner to code, organize, integrate, elaborate on or transfer information is imminent for 
instructional programs (Orr et al, 1994; Hannafin, 1989). But all those cognitive activities are heavily depend upon screen 
design or interface of the instructional software. Well-designed screens should allow for maximum learning from the 
materials while providing the learner with appropriate control of the learning process. Effective interface has to maintain 
motivation and be feedback rich (i.e. the result of each action should be clearly visible and interpretable). As well, attention 
can be controlled by only making operators appropriate to the task available on the screen, and placing the animation 
phases of the processes under the active control of the users (Carroll and Rosson, 1987; Shneiderman, 1992). Recently the 
direct manipulation (DM) interfaces (Dix et al, 1993) allow the users to directly interact with the screen objects and 
operators with the interventions signalled through the mouse-pointer. It is the manipulatable interfaces of computer 
proceduralisation of a mathematical subject matter, namely the addition, where early primary school children pose many 
problems that this study focuses upon. 

Children’s Learning of Addition 

During pre-school years, children’s use of language to represent numerical information and relationships becomes 
increasingly important, they must learn their culture’s number words, map these number words onto their existing number 
knowledge, and then learn the many ways in which number words can be used in quantitative situations, such as counting 
or measurement (Fuson, 1988). The development of basic number skills spans a 6-year period for most children, ranging 
from the ages of 2 to 8 years. (Fuson, 1991; Piaget, 1965). In this period, children memorise the number words, understand 
that each word represents a different quantity and develop their counting skills. These skills are used in many different 
contexts such as for measurements or for arithmetic. 

Informal mathematics involves active construction, not only passive absorption of information. Children develop 
and apply informal mathematics because it is personally meaningful, interesting and useful to them. But informal 
mathematics has its limitations, child’s mental addition, for example, is restricted to small numbers (Baroody and 
Ginsburg, 1986). Understanding cannot be imposed upon children. It evolves as they actively try to make sense of the 
world. Meaningful learning occurs when children intellectually and emotionally engaged in activities. As well, it occurs 
when they encounter novel situations that excite their natural curiosity. As cognitive research indicates that, with any 
mathematical content, learners progress developmentally from concrete to abstract thinking (Davis, 1984; Dockrell and 
McShane, 1993), they must be given the opportunity to assimilate school mathematics. Mathematical symbols, 
computational algorithms and procedures can make sense to children if it is connected to their existing, personal, counting 
based knowledge of mathematics. However, a gap between formal instructions and a child’s existing knowledge prevents 
assimilation (Hiebert, 1984). It can make school taught skills and concepts seen foreign and difficult to children. 

Addition domain represents the first attempt that schools make to teach what might be recognised as formal 
mathematics, This means learning to symbolically represent a problem situation, operate on the symbols and interpret the 
results. However, when first learning to solve addition problems, children rely heavily upon the use of manipulatives. As 
the child gains experiences and maturity, the favoured strategy shifts to finger counting (Carpenter and Moses, 1984). The 
use of manipulatives serves mainly two purposes: First, the sets of objects represent the numbers to be counted. The 
meaning of the abstract number, say 3 of an addition problem of 4+3, is literally represented by the objects. Second, 
referring to the objects during counting helps the child to keep track of the counting, that is, the child knows to stop once 
the last object is tagged with a number word. For most children, the shift from finger to verbal counting is gradual, and 
children don’t have to be taught these different ways of solving simple addition problems but rather discover for themselves 
the most efficient procedure (Groen and Resnick, 1977; Sieglerd and Jenkins, 1989). Further, learning to solve multi- 
column problems (e.g. 23+19) involves developing not only efficient problem solving strategies but also an understanding 
of place value and how to carry or trade. When solving these problems, children initially rely upon the knowledge acquired 
for simple addition problems. Strategies for solving more complex problems include counting and decomposition, or 
regrouping, as well as the formally taught column-wise procedure (Ginsburg, 1989). However the most difficult process in 
complex addition involves carrying. According to Gearry (1994), two factors appear to make carrying difficult for children 
and some adults: First, carrying often comprises manipulating numbers mentally. In the problem of 37+48, the child must 
first add 7 and 8. Then he must mentally note that a carriage has taken place and retain this notation in working memory, 
whilst writing the units-column answer. Here it is possible to forget the carriage. Second, skilled trading involves an 
understanding of place value where the child needs to comprehend that the “1” traded from the units to the tens column 
actually represent “10” not “1”, failure to understand this contributes to children’s trading errors well documented in the 
literature (Ashlock, 1990; Fuson and Briars, 1990; Hiebert, 1987, Romberg and Collis, 1987). 

To overcome children’s difficulties within addition and to prevent errors and misconceptions from developing, 
Brown and Vanlehn (1980) suggest using illustrations. Lowell (1982) also suggested that because logical mathematical 



experience is abstracted from one’s actions and not from the materials themselves, structural apparatus of all kinds on 
which the child performs cognitive actions can play a useful role in understanding of the operation of addition. This 
argument was later supported by Collins and Brown (1988) and Thompson (1992) suggesting that through the structured 
procedure capturing systems which offer simple devices, perceptually reflective learning on concrete items can be achieved. 
Through the students’ manipulation and inspection, aspects of the device structure can then be explicitly represented, 
annotated and become the subject of didactic discussion. Hence computer medium with embedded interactive cognitive 
tools (Kaput, 1991) can be focus of the design, aiding learning by making internal processes more public and available for 
examination and reflection. 



Procedural Learning Environments 

It is crucial to consider the interface design issues for systems with interactive manipulatives and proceduralisation 
tools, before considering the architecture of a procedural learning environment for primary school children’s learning of 
addition. To develop conceptual understanding of the domain through operations, a software system has to service the 
learner with operational facilities to undertake tasks. The interface design principles to be adopted were taken from 
Shneiderman (1983, 1992). His recommendations were for a) continuous representation and display of objects and actions 
of interest, b) physical actions (e.g. mouse clicking, icon dragging) instead of language syntax to achieve changes in the 
object world, and c) rapid and incremental operations whose impact on the objects of interest is immediately visible. 
Moreover, the interface design should follow the extended principles expressed by Hutchins et al (1985). Although this 
study is not focused on human-computer interactions, it is necessary to make careful efforts to follow and interpret 
established guidelines for designing a procedural learning environment (PLE), the BALANCER. See Figure 1 for an 
architecture of the PLE. 

A variety of teaching and learning approaches should be supported by learning environments in order to aid the user 
in proceduralising his/her interaction with the system and eventually be less prone to errors. The environment should 
regulate the control between the student and the system, accommodate real-life tasks and their solution methods which are 
rich in feedback and provide interactive illustrations supporting conceptual understanding, learner controlled inspections 
and problem solving. On the basis of a firm conceptual understanding the student’s actions, as part of a procedure, are to be 
evaluated and reacted by the computer program to provide feedback about the effects the action would have in the real 
world. The student then takes successive action and each time explores more information. Further, because developing a 
firm conceptual understanding of addition domain depends heavily upon the constructive work with mathematical objects in 
a mathematical community and because the students need building materials, tools, patterns and sound work habits to learn 
operational relationships, the functional components of such “procedural environment mainly consist of the followings: (i) 
A concrete object space, the base for quantification, in order to represent the domain, (ii) A student-environment interaction 
language by which the student can operate an object world in ways that show the effects of their actions and that connect to 
representations of the object space and its relations at higher levels of abstraction, (iii) A curriculum management office 
(CMO) (inspired from Draper’s lesson office, 1991) to specify and manage the task curriculum and record student 
performances for further use. (iv) User-system interfaces which are needed for students to apply the interaction language 
and manipulate the object world, and for teachers to specify and customise types of curriculum tasks for the curriculum 
management office. 



Domain Representation I 



Environment 



Objects 



Operators 



Interaction 

Language 



Interface 



J^Student^ 
I Interfac^l 



Currriculum Management 
Office 



Task Specification Tools 



Task Space 



Performance Record 






Activity Manager 



Screen Design 



Task Interaction 



In 



~| Interface H '1 



Teacher? 



Figure 1: An architecture of the PLE 

The conceptual and procedural knowledge summarising the curriculum to provide a domain representation (as 
semantic networks for the designer) is an essential requirement for the designer, because the objects, their attributes and 
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relationships between the attributes are determined by the domain representation. It will also clarify the operations the 
student can perform on the objects and the operators within the learning environment. The student-system interaction 
language will enable students to work on the object space and ideally allow them to develop their procedural or explanatory 
models of the world at higher levels of abstraction. This, in turn, informs the task space that represents the curriculum the 
teacher plans to place before the learner. The user-system language benefits from teaching experience in the domain as it 
requires an awareness of the conceptions and alternative conceptions the learners might employ and which the PLE should 
influence, correct and extend. The user-system language becomes a tool for thought and a means of knowledge interchange 
between the learner and the PLE. To aid the efficiency of these interchanges and to facilitate modes of working with the 
language is enacted through an interface where the display screen becomes the “workdesk” for the student. 

The task manager is able to display the appropriate task which is selected in pre-specified sequence or adaptively 
by taking performance records into consideration. It will also manage the actual interactions with the learner. A task 
specification basically includes instructions and material for the learner, the arithmetical objects and environment facilities 
to be used by the learner. Any additional feedback and concluding comments to be supplied will also be contained in the 
task specification part. The system-learner interface allows students to undertake the tasks (via the interaction language) 
and to see the consequences of their actions and decisions. Thus, through the CMO tasks specifications, the teacher can 
follow a directed or an exploratory approach and also adjust the environment for individual or co-operative working. 

Features of The Balancer PLE 

To implement the design issues outlined, a proceduralisation environment was designed for school children’s 
addition which is a problematic domain causing learning difficulties. The addition domain is the one where different type 
of instruction is possible, varying illustrations, both dynamic and static, may be employed and include proceduralisation of 
explanations, practice and problem solving. Therefore, the BALANCER procedural learning environment should have the 
following features to support the approaches to instruction of addition within the framework of the above system 
components: (a) Interactive mathematical, linkable objects and operators which are visual and can be directly manipulated 
by students, (b) Mechanisms to check the validity of students’ methods, and to provide feedback on the appropriateness of 
their actions in relation to the presented task, (c) Be able to move its presentation (representation) modes from concrete to 
symbolic as the learners gain in competence, hence a seamless transition from objects to quantification is enabled. The 
equivalence between concrete representation (objects) and symbolic (representation) must be explicit to support the link, 
(d) Permit experimentation with concepts and procedures in ways that relate to the pupils’ experience, thus supporting 
guided discovery as well as more directed methods of instruction, (e) The learning to be contextualised and procedural via 
the types of tasks that are specified within the CMO. (f) An operator that will enforce to employ “carriage” principle in 
operating numbers in a way that helps to explore the complex numbers addition strategy. 




Figure 2: A window of the BALANCER 

The Design and Implementation of The Balancer 

Before designing the above specification of the BALANCER, an informative investigation with five teachers was 
undertaken to obtain their opinion on the use of materials for teaching addition (both one digit and two digits numbers). 
They confirmed the subject, particularly adding two or more digit numbers where carriage is needed, is difficult for 
children, and suggested that pupils will benefit from interactive proceduralisation of the computerised balance. Following 
their suggestions, a semantic network of the addition domain was prepared, it demonstrated the relations between concepts 
and operations within addition and aided the design. As children’s operations of numbers is initially based upon concrete 
materials, manipulatives and counting of these materials, it was decided that an object should represent the concrete state 
of the number “1” and be from daily life, i.e. a box. The object will later be tagged with the number as 1. The weight of an 
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object, say, 1 gram for 1, will also reflect the number and the operator, a hand-scale or a balance will process the objects 
with regard to their weight, hence tagged number. The manipulatable object could be combined with other countable 
objects in the scale and be represented as in the pictorial and symbolic forms. 

With the help of the task space, the operator, a balance, will allow pupils to investigate the addition procedure in 
different activities (e.g. counting objects on the pans of the scale, comparing set of objects and balancing the sets will be 
undertaken). A sequence of activities may be as follows: 1. balance the scale by using the pictorial boxes, empty boxes, 
being equal in weight, 2. balance the scale by using the pictorial boxes tagged with numbers, 3. balance the scale by using 
the boxes with numbers, carriage is involved. 

The metaphor of a BALANCER was designed and developed with the learner being able to directly manipulate 
boxes through an operator. The performance of the operator is under learner control with each phase of the procedure 
shown visually first and later becoming and linking to symbolic representation. The combination of the boxes through the 
operator provides opportunity for pupils to investigate the comparison of sizes of the weight of the objects, the counting in 
relation to the weight, hence numbers, and the equivalence of the two added boxes on one pan and as its sum on the second 
pan. See Figure 2 for a snapshot of the BALANCER. 

For the system to monitor and evaluate the operations accurately, the BALANCER carries out its own 
manipulations formally, and provides a mapping between the weight as concrete representation and symbolic 
representations so that the system can aid the more formal development of student’s understanding in a seamless way. For 
instance, when adding 18 and 19, the student drags boxes with tags of 18 and 19 into the left pan of the scale. The scale is 
then unbalanced to the left, and a slot (box) on the right pan into which the student is to enter number appears. The student 
can either enter the correct number directly to balance the scale or add 8 and 9 first, enter 7 and mark the number “1” in the 
knob component of the balance to indicate that “1” is to be carried. Next, he adds 1 to 1, and the carriage is automatically 
added. Finally the correct result is produced and the scale is balanced. Note that depending on the size of the numbers in 
the pans, if there is inequality, the scale exhibits this by unbalancing the pans. If an incorrect answer is given, the leamer is 
asked to try again, with the unbalanced scale remaining as a hint. The box representing the sum could also be moved out of 
the pan for further use or reference. So it becomes part of the object space in the work environment of the system. That may 
then allow co-operative activities for children. The teacher can tailor tasks which introduce the preliminaries of adding and 
which encourages to deal with large numbers. When the carriage is needed, the operator through its knob helps the leamer 
to determine an appropriate carriage. 

The Curriculum Management Office 

The task specification is accomplished in the environment through the office which permits the task content, the 
specification of the representational form of the objects (empty boxes, tagged boxes each representing “1”, boxes with 
different numbers tagged) and the sequence of tasks to be ordered in a curriculum. Answers are also specified (as checks 
for the system) and the teacher can provide comments and overall task feedback. Only the teacher through mouse-pointing 
can access task authoring pages (one different page for each task) of the CMO. 

The CMO passes the sequence of curriculum tasks to the activity (task) manager of learning environment that 
controls the interactions with students and keep records of their progress. The office can accommodate prescriptive tasks 
(as practice examples) or more open-ended exploratory assignments. Further, the interface, through its mouse-driven direct 
manipulation, provides the leamer with close control of the system components, and all these activities have clear effects. 

The BALANCER was implemented in Asymetrix ToolBook™ on IBM PC computers. It is an object-oriented 
authoring environment providing versatile design tools to assist rapid prototyping which are especially useful for building 
graphical systems. The objects are buttons with appropriate scripts instructing the system to place the objects (boxes) on 
the pans (which are fields and graphics) and execute other control messages. Similarly, the task authoring part for the 
teachers have fill-in forms (fields) and iconised buttons to convey messages. These screen objects are held on pages that 
also have a supplementary pull-down menu for editing, resetting, getting new task, checking and asking for help. 

Pilot Evaluation Studies and Suggestions for Further Work 

The prototype software was tested through a small formative study. The pilot study was conducted with four second 
year elementary school students (aged 8, 8, 7.8 and 7.10, two girls and two boys) to test the interface features of the 
program, and to ensure that the students were able to use the system’s interactive tools to work out the problem tasks given 
in social contexts, word problems. The amount of pre-training time to learn the features of the system was also to be 
estimated. The students took part of the study in an empty room of the school where the researcher was present. A brief 
introductory session introduced the children what the system components are and how they are manipulated. Four problem 
tasks were presented within a directive worksheet as well as on the screen. Although the students were chosen among the 
ones having difficulties in carrying out addition operations, they did not have assistance to understand the tasks, all four 
students had no difficulties in manipulating or understanding the mouse-driven interface (it took 7-10 minutes for the 
students to become familiar with the system). The children were extremely intrigued in balancing the scale for addition 
tasks, and their progress through all the tasks was much quicker than expected. The students were also able to provide 
satisfactory answers to the tasks. 

The evaluation study showed that the students did not have any difficulties with the interface and the approach was 
interesting and well received. However, the testing of the software with target students in the real classroom environment 
with wider task regimes is needed to examine the value of the procedural approach. How effective are different task 




regimes in helping the acquisition of addition operation? This type of evaluation study should ascertain how such tasks are 
managed in the classroom and what worksheet and other supports teachers consider necessary. Further, evaluation studies 
with paired students should be arranged to examine in detail how children use the software and how they discuss the tasks 
and tasks sequences in the environment. Studies with teachers should also examine what role the teacher should adopt and 
the type of discourse that results. 

To conclude, it was clear that the developments in interface design should extend the educational ambitions of 
computer based learning which continuously faces with new techniques. Procedural environments with their flexibility and 
mixed initiative modes of learning seem a promising innovation, particularly when their design methodology can be 
formalised and supported through evaluation studies that embrace both teachers and students. 
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Abstract: This presentation demonstrated computer software that helps students better understand 
Newton's first law. Two studies of effectiveness of the software were reported. The first found that 
males benefited from use of a fanciful version of the software, but females did not. The male 
oriented scenario used in the simulation and the lower interest and prior experience of females in 
physics may have made more difficult for females to transfer the computer experience to the first 
law concepts taught in the chapter. A second study, using software that more explicitly related 
itself to the chapter, found that both male and females students profited from prior use of the 
simulation. They developed and demonstrated a better conceptual understanding of the implications 
of the first law. The results suggest that, contrary to much current practice, simulations may be 
more effective instructional tools if used prior to more direct instruction. 



Introduction 

This paper demonstrated computer simulation software designed to help students better understand 
Newton's first law and reported two studies that examined the effectiveness of the software.. Helping students learn 
about the first law is important because many students have prior misconceptions or alternative conceptions about 
motion. Such alternative conceptions interfere with the students’ ability to construct understanding of newly 
presented theory (Wandersee, Mintzes, and Novak 1994). 

Computer simulations potentially offer students opportunities to explore physical or biological situations 
that may be impossible, too expensive, difficult, or time-consuming to accomplish with actual laboratory or real-life 
experiences (e.g. frictionless environments). Even if real-life exploration is feasible, such experimentation can be 
supplemented by simulations that offer students the opportunity to explore a wider range of variables more rapidly. 
Such simulated experiences potentially can be used to confront alternative conceptions, produce disequilibration 
and, with appropriate scaffolded instruction, lead students to a new accommodation (Piaget 1983) 

Despite this potential for the use of simulations, empirical results examining the impact of simulations in 
science education have been mixed (Akpan 1998). One potential way of resolving differences in existing research is 
to examine the ways simulations have been used in existing experiments. Typically, simulations have been used as 
surrogates for laboratory experiments and, like most laboratory experiments, have followed didactic instruction on 
the topic. However, several theoretical perspectives suggest simulations may be more effective if used prior to 
formal instruction. For example, Piagetian theory argues that knowledge is constructed through action. Actions 
leading to disconfirmation of expectation produce disequilibrium and the learner may construct or accommodate 
new mental structures to resolve the disequilibrium (Piaget 1954). Bruner (1966) adapted Piagetian theory into the 
idea that learning requires experiences at an enactive level before iconic and symbolic experiences can become 
meaningful. An enactive level requires participartory experiences with the domain of interest. An iconic level 
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involves graphical representations of experiences in the domain of interest. A symbolic level involves 
representation in an abstract symbol system. Klausmeier and Allen (1978) argued that conceptual development 
proceeds through a series of four stages of understanding. In the earliest stage, a label is attached to particular 
concrete experiences. Later stages lead to the development of a formal symbolic understanding. Using Tulving’s 
(1972) concepts of episodic and semantic memory, Andre (1986) suggested that creating imagery based 
representations of experience in episodic memory was necessary in order to provide an experiential base that would 
allow symbolic representations in semantic memory to have meaning. Similarly, Paivio's (1986 )dual coding theory 
suggests that creation of imagery based representations along with symbolic representations facilitates 
understanding. The important point is this. Multiple theoretical perspectives argue that the learners need to have 
non-symbolic experiences within the domain of interest in order to be able to map symbolic expressions onto 
perceived reality and to give such symbolic expressions meaning. 

Thomas and Hooper (1991) articulated an instructional model that incorporated these theoretical insights. 
They proposed that simulations could be used instructionally in one of five roles. Only the first role is relevant in 
the present context. The first role, experiencing, involved the prior use of simulations to help provide an 
experiential base that would set the "cognitive or affective stage for future learning" (p. 499). Thus, these theoretical 
perspectives suggest that experiential simulations used prior to didactic symbolic instruction should facilitate 
students' construction of meaningful understanding about science concepts, principles, and schemata. 

Hooper (1986) and Brant. Hooper, and Sugrue (1991) tested the Thomas and Hooper (1991) experiencing 
model. In studies involving students in college level computer science and animal science classes, they confirmed 
that using simulations before, as compared to after, lectures led to improved learning. Use of the simulation after 
instruction did not improve learning as compared to control groups that did not receive the simulation. 

White and her colleagues (1984, 1987) developed a set of simulations called Thinker Tools. Thinker Tools 
provided a simulated environment that operated in a manner consistent with the first law. Sixth grades students who 
experienced Thinker Tools outperformed high school physics students who had just completed a unit on mechanics 
on a test of conceptual understanding of the first law. The sixth graders had not received any formal instruction on 
mechanics. Frederickson, White, and Gutwill (1999) showed that leading students through a graduated series of 
electricity simulations led to the development of dynamic mental models that facilitated understanding of electricity 
concepts. 



Study 1. 

The prior research had not separated cognitive and motivational explanations of exploratory simulations. 
Use of a simulation before instruction might be fun or arousing. Students with higher arousal or motivation might 
leam more from the didactic instruction that followed. We assessed this possibility in the first study. We developed 
a computer simulation similar to Thinker Tools that ran on Apple II computers and contrasted it with the use of a 
computer game involving a non-Newtonian motion (variants of Pac-Man and Snakebyte). The game or simulation 
were used either before or after students read a textbook chapter on motion. A control group received no computer 
experience. If the effect of the prior use of a simulation were primarily motivational, then the game and computer 
simulation groups should show similar improvements in performance over the control groups or computer 
experience after instruction groups. The Motion Games simulation allowed the student to apply "impulse" forces to 
a simulated spaceship. The impulse force mimicked a short duration force applied to the object that would produce a 
given increase in the velocity of the object. The simulation context made the students "spaceship captains-in- 
training" and gave them progressively more complex missions to accomplish. The controls allowed the force to be 
applied horizontally left or right or vertically up or down. Thus, control of the ship forced students to apply 
intuitively vector combinations of force to achieve goals. Accomplishing the missions thus led students to 
experience and intuitively apprehend how the first law controls motion. In Frederiksen et al.'s (1999) terminology, 
the simulation experience would allow students to construct a dynamic mental model of motion. 

Volunteer college students were randomly assigned to the conditions and completed a pretest, interest and 
prior experience inventories, and a background questionnaire before reading the text or completing the computer 
experiences. Subsequent to reading and the computer experiences, the students completed a posttest focused on 
conceptual understanding of Newton’s first law. Male college students who used the simulation before reading the 
chapter performed better than both males who used the simulation after reading and male students who did not used 
the computer games or did not received a computer experience. This pattern of results suggests that simulations used 
before instruction have primarily a cognitive, and not a motivational effect. 
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That conclusion was tempered, however, because no significant effects were found for female 
students. As is typical (Kahle and Meece 1994), females, as compared to the males, reported less interest in and 
experience with physics and also scored lower on the pretest. In addition, the space captain scenario that may have 
been more male than female oriented and did not explicitly relate itself to the chapter on motion. The lower prior 
interest and experience and the perhaps more male-oriented scenario may have made it harder for females to create 
meaning by relating the physics presented in the chapter to their simulation experience. Students often find it hard to 
transfer between two learning experiences if they do not recognize a connection between the experiences (Gick & 
Holyoak 1980; Pressley & McCormick 1995). 



Study 2. 

We explored this interpretation in the second study by using a simulation that more explicitly related itself 
to the physics of motion. A Macintosh version of Thinker Tools is now available. It is less fanciful than our motion 
simulation and more explicitly focuses attention on critical variables in understanding motion. In the second study, 
we compared the effects of use of Thinker Tools to a non-Newtonian computer game used prior to reading a chapter 
on motion on male and female students' conceptual understanding of Newtonian principles. We hypothesized that 
this more focused motion simulation would lead to improved performance for both males and females. 

The participants were 24 male and 29 female college volunteers. Again the participants first completed 
background, interest and experience questionnaires and a pretest. They also completed verbal ability, mathematical 
calculation, and spatial ability tests. The students were randomly assigned to complete either a series of activities 
from the Thinker Tools simulation the computer game before reading a short chapter dealing with the physics of 
motion. Two days after studying the chapter, the students completed the posttest on conceptual understanding of the 
principles of motion. 

The results revealed significant main effects for both condition and gender. While males did better than 
females, the theoretically and practically important result was that both male and female students receiving the 
Thinker Tools simulation did significantly better than did students receiving the non-Newtonian computer games as 
a prior experience. 



Discussion 

The major purpose of these studies was to examine if use of a simulation that challenged misconceptions 
about motion as a prior exploratory experience before students read a chapter on the principles of motion would 
facilitate learning. Prior research in other subject matter areas had shown benefits of simulations used as prior 
exploratory experiences. In our first study, use of a fanciful simulation that illustrated Newtonian motion facilitated 
learning for males. In our second study, use of a less fanciful simulation that explicitly related the simulation to 
motion helped both males and females learn more from a chapter on motion. We argue that the greater prior 
knowledge and experience of males in the first study would have made it easier for them to connect the simulation 
and the chapter. In the second study, the instruction led all students to connect the simulation and the chapter. It is 
well known that transfer between tasks may not occur unless students perceive a connection or are explicitly shown 
the connections between the tasks (Gick and Holyoke 1980; Pressley and McCormick 1995). Thus, we argue that 
use of exploratory simulations prior to students’ formal study of scientific concepts will facilitate learning. However, 
the facilitation will occur only if students are led to see the connections between the experiences in the simulation 
and the scientific concepts they formally study. 

In the M/SET presentation, we demonstrated the software and report the results of these two studies. The software 
is available free from the Web. For the Mission Newton "spaceship captain in training" software that runs on 
MSDOS/ Windows computers, see http://www.public.iastate.edu/~tandre. For the Thinker Tools software, see 
http://thinkertools.berkeley.edu/tt. 
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[1] While many authors make theoretical distinctions between the term alternative conceptions and misconception, these 
distinctions are not relevant to the present study. Regardless of ones theoretical preference for these terms, thephenomena that 
students have conceptions about motions that conflict with those of the culture of physicists is well established. 
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Abstract: The purpose of this paper is to introduce an animation module CSAnim as extension 

to the S.E.A.L. web-based education system [Ausserhofer, 1999a], The main application of CSAnim is 
the generation and the display of a dynamically processed graphical visualisation of computer-science 
topics based upon user-input. The introduction will set the focus to the problem in general whereas the 
problem-analysis will show, why animation techniques - which have found to be a successful extension 
to traditional teaching methods - are not sufficient enough, A new approach is presented as solution to 
this and the integration into an existing education system is shown. The paper ends with future aspects 
and possible applications. 



Introduction 

Teaching computer science and computing is a challenging task. The reasons for the difficulty and the 
problems in teaching the science of computing are various, one of which is truly remarkable. Among the fact, 
that a primary goal is the teaching of theoretical subjects with the requirement of a well built mathematical 
background - it is clear that the teaching of practical programming skills is also of vital interest. The 
fast development of technology and the rapid change of programming languages make this task even more 
difficult. 

Web-based education systems have been developed and introduced to support the teaching and learning 
of computer science topics and computing - nevertheless - many years of experience have shown us, that 
students still have serious problems in learning and understanding certain elementary mathematics- and 
computer-science topics. 

The purpose of this paper is to outline such topics and to introduce an improving methodology for 
the teaching and learning process. Animation and visualisation techniques are the basis for the solution 
approach presented within this paper. The paper starts with a problem analysis and presentation of the 
solution approach and it ends with the presentation of the characteristics of the new methodology along with 
its implementation and its integration into an existing teaching and learning environment. 

Problem Analysis and Solution Approach 

Experience over years shows us, that independent from the teaching methodology applied to, independent 
from the presentation media used for and finally independent from the practical examples chosen to explain 
- there are subjects which are still hardly understood and barely learned by the students due to their 
complexity and difficulty. 

An information inquiry proved that it is mainly topics related to computer science processes which are 
found difficult to understand, two of which are listed as examples: 

Evaluation Strategies of Expressions: Students typically find it difficult to understand the process of 

expression evaluation, namely the difference between Call-by-Name , Call-by-Value and Lazy- Evaluation. 
Recursive Function Calls: Students hardly know and barely learn how a recursive function call is 

performed and what really happens at each recursive step. They have problems in isolating the base case 
and the definition of the inductive step. 
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A major share of people is visually centred, i.e. cognitive recognition is amplified through visual im- 
pressions. Information presented mainly in visual form (pictures, graphs, video sequences, ... ) is easier 
understood and faster integrated. This is only one reason why graphical visualisation and animation tech- 
niques have been successfully experimented with - not for educational purposes only. 

A survey on animation and graphical visualisation tools shows that 

• there exists a large number of animation tools, specifically designed and implemented for various 
purposes except the animation and visualisation of computer science subjects as described before, and 
that 

• most of the existing approaches cannot be adapted and re-used in order to meet our requirements due 
to their very architecture and design. 

Both perspectives have to be taken at a closer look. Nearly all of the present existing animation and 
visualisation systems can be classified in either one of two categories: 

1. Predefined Examples: Animation tools referring to this type implement more or less predefined exam- 
ples with little or no possibility to interact and/or parameterise. The animation sequence can be consumed 
like a movie or a comic strip, started, stopped and replayed on user request. User input is limited to set- 
ting/changing parameters or to flow control. Most often these tools are technically brilliant, with excellent 
animations, hiding the implementation inside. 

2. Predefined Animation Tool: Representatives of this category are characterised by an implemented 
framework or software library which can be used in order to create and build animations. Users of these 
tools have to design and implement the software to model their problem of interest and have to integrate 
the animation tool into it. They further have to specify how to create the animation sequence by choosing 
from the command set of the animation library. 

Both approaches are unsatisfactory within the scope of this work. Creating animations based upon the 
first technique is neither new nor very difficult. But it lacks the architecture to be applied to most or all 
of the representative examples of the problem domain. An example for every problem to be graphically 
visualised would have to be implemented, with little or no interaction for the user. 

The application of the second approach is even worse. Students have problems in understanding a 
process which is hidden inside computer architecture. The animation technique would force them to first 
model the problem by means of a software solution and then integrate the animation tool in order to 
visualise the solution. This is a contradiction by itself, students cannot model problems of which they have 
no understanding of. 

In order to meet the requirements of successful animation in teaching computer science and programming 
topics, three prerequisites have to be defined: 

1. Animation and graphical visualisation has to be individual, i.e. it has to be built from the particular 
problem entered by the user. 

2. The animation program must take the user-input for the animation ”as-is” } i.e. the user shall be able 
to enter the problem in a way he is used to argue about it. No special syntax shall be defined. 

3. The user shall be set free from all questions of how to build the animation sequence out of his input 
data. The animation sequence must be built dynamically and pararneterised. 



Dynamic and Pararneterised Animation - an Example 

Example Definition 

The ” evaluation process of expressions” is one problem which turns out to be difficult and which is hardly 
understood by first year students, no matter which educational system is used for presentation. The purpose 
of this section is to introduce the example itself and to further use it as explaining example for animation. 



Given a function definition and a value expression, denoting the recursive function call as follows: 

f(x) = 2*1 + 4 (1) 

5 = /(/(/( 3 ))) ( 2 ) 

The purpose of (most) computer systems is to evaluate value expression. Independent from the strategy 
which is used to calculate the value, the result for this example should be g = 52. 

Computer scientists are not only interested in delivering correct results but also have to deal with finding 
effective ways for doing so. Different strategies for evaluating expressions open different opportunities with 
individual advantages and disadvantages. Three main strategies for evaluating expressions are well-known 
and have to be understood by computer-science students. 

Call by Value: The value x of inner-most function is calculated, the result is then supplied to the function 
body of the value definition again (Fig.l). 



/(/(/(3)))->/(/(2*3 + 4))=/(/(10)) 


f(x) = 2 * x + 4 


x = 3 




— > /(2 *10 + 4) =/(24) 


f(x) = 2 * x + 4 


x = 10 




2 * 24 + 4 =52 


f(x) = 2 * x + 4 


x = 24 





Figure 1: Call by Value Evaluation 

Call by Name (Normal Order): The value x is immediately substituted into the body of f of the value 
definition. The value of the resulting expression is recursively evaluated (Fig. 2). 



/(/(/(3))) — > 2 * /(/(3)) + 4 


/(x) = 2 * x -1- 4 


X = /(/( 3)) 


-> 2 * (2 * /( 3) + 4) + 4 


/(x) = 2 * x -1- 4 


x = / (3) 


-> 2 * (2 *. (2 * 3 + 4) + 4) + 4 


/(x) = 2 * x + 4 


x = 3 


-> 2 * (2 * 10 + 4) + 4 


/(x) = 2 * x + 4 




-► 2 * 24 + 4 


/(x) = 2 * x + 4 




52 







Figure 2: Call by Value Name Evaluation 

Call by Need (Lazy Evaluation): Value x is immediately substituted into the body of f of the value 
definition (as before), but each argument is evaluated at most once, when it is needed. 

System Architecture 

The Animation module for dynamic and parameterised graphical visualisation ( CSAnim ) is integrated into 
a web-based education system called S.E.A.L. [Ausserhofer, 1999a]. S.E.A.L. is built in client/server architec- 
ture and primarily used to support teaching and learning of computer-science and programming. Teachers 
use S.E.A.L. to present their lecture notes and to show/execute programming examples; students use S.E.A.L. 
for learning purposes and training skills from remote. 

CSAnim is an integrated server module to S.E.A.L.. It receives its input from remote users through the 
WWW. Input is entered into a S.E.A.L. front-end (JEdit) and sent to the system over the WWW. The results 
are re-displayed at the client site by means of the X-protocol technology. Fig. 3 presents the general system 
architecture along with the interface definition. 

The system architecture follows the principle introduced with the algorithm animation system XTango 
[Stasko, 1992]. Therein, the animation model is separated from the interpretation of it. The animation 




realised in here is of the same principle - the CSAnim module is responsible for building the animation 
model, whereas a third-party animation interpreting software handles the presentation of the animation. 

Animation Model: CSAnim consists of an animation generator which is designed and implemented in 
the Java programming language. Two rather recent developed tools have been used for support- 
ing purposes. JFLEX [Klein, 1998] is used to carry out the lexical analysis of the user input. CUP 
[Hudson, 1998] is being included in order to define the accepted grammar for the problem specification 
and to build the parse tree from the user input. The CSAnim module implements an abstraction layer 
to the animation command language which is understood by the subsequent animation interpreting 
software. 

Model Interpreter: The interpretation of the animation module is done using the Samba animation inter- 
preter [Stasko, 1995]. SAMBA was originally designed for the algorithm animation package XTango , 
representing the interpretation module. S.E.A.L. is the result of a research project where one objective 
was not to work on a too broad research frontier, thus re-using well-established system parts where 
possible. Samba is not perfectly well suited for our application but works sufficient for the prototype 
version. 

Dynamic Animation of Evaluation Strategies 

It is almost impossible to describe a dynamic animation process in textual form - at least - it seems not 
very useful. Thus the purpose of this section is to describe the principle of how the dynamic animation is 
generated within the S.E.A.L. education system and to present an application example. The principle of 
dynamic animation of evaluation strategies can be seen from the system architecture (Fig. 3). 

User Input Users access the web-based education system by means of any ordinary Java enabled web- 
browser software. By authenticating themselves to the education environment they can load and open a 
S.E.A.L. editor environment. This environment us used to enter all information which shall be processed by 
the system. 

Information, concerning the problem statement of an expression definition is entered using the notation 
of the SML programming language syntax [Milner et al., 1997], This language is currently used in our basic 
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computer science lectures, unless the system is able to handle any notation as long as the syntax can be 
defined formally. 

The problem statement of an expression of which the evaluation shall be explained and graphically 
visualised consists of a function definition and a referring expression value statement (see input below). 

fun f(x) = 2 * x + 4; 
val g = f (f (f (3))) ; 

Data Processing The input statement is submitted to the education system server by simply pushing a 
submit button from the referring menu. The data, together with administrative information necessary, is 
then sent to the S.E.A.L. server through the Internet using a native CRS protocol 

Creation and Presentation of the Animation Sequence The S.E.A.L. communication server handles 
the expression statement to the CSAnim program module. This program parses the input and generates the 
desired animation sequence out of it. The result is a simple ASCII file containing animation commands which 
can be understood and processed by the animation interpreting module SAMBA. SAMBA is started by the 
S.E.A.L. system, parsing and processing the animation control commands and displaying the animation at 
the client side using the standardised X Protocol. 
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Call by Value - Evaluation Strategy 

Function : f < x ) = 2 » x + 4 

Value : g = f( f( f ( 3 ) ) ) 

r i :i f< f< f< 3 ) ) ) -> f(f(2*3 + 4))s f< +'< io ) ) 

[ 2 3 f ( f ( 10 ) ) -> f ( 2 * 10 + 4 ) = f ( 24 ) 

[ 3 3 f ( 24 ) 









Function Substitution Process 

f ( 24 ) = 2 * 24 + 4 

where x is 24 

Press RUN to continue! 
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Figure 4: CSAnim Example Animation 



Fig. 4 shows the presentation of a sample animation of an evaluation process for expressions following 
the CalLby-Value principle. 
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Evaluation Process: The large window in the back shows the evaluation process in a step by step manner. 
Each line represents one evaluation step. The actual step is highlighted whereas previous steps are grey- 
shaded. 

Substitution Process: Each substitution step is graphically visualised (see lower left window). In this 
view, the substitution of the value x=24 into the function expression f(x) — 2 * x + 4 is animated. 

Control Panel: The user can interact with the animation by means of the control panel (small window in 
the mid right), i.e. pause or continue the animation sequence and change the presentation speed. 

Thus users receive animation sequences directly based upon their input statements without the need for 
dealing with the building and processing activities of the graphical visualisation themselves. 



Conclusion 

By means of dynamic animation, which is based upon the problem individually entered by the student - a 
major improvement with respect to the learning and understanding of traditionally difficult problems is made. 
Dynamic animation combines the advantages of graphical visualisation in general with the individuality of 
personal teacher education. 

Future Work 

S.E.A.L. is in prototype state - and will be developed further. By now, the system is mainly used for 
teaching computer science and computing [Ausserhofer, 1999b]. The architecture is far more general, thus 
it is possible to extend the functionality very easily. We consider to extend the system for other fields and 
subjects, namely electrical engineering, mathematics or computer graphics. It is even possible to adapt the 
system to fit the needs for corporate education programs and training on the job purposes. 

By now - the system is being tested in real live situations and will be evaluated by the end of the 
year 1999. SAMBA was originally designed for algorithm animation. Further-on it would be interesting to 
implement a native S.E.A.L. animation parsing program in order to extend the functionality with respect to 
user interaction. 
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Abstract: This paper describes the results of three summers of teacher training initiatives in 
multimedia and the Web for the classroom as well as a trainer of trainers model currently being 
undertaken for faculty at San Jose State University based upon the results of the summer 
workshops. An original objective of the summer workshops was directed at providing faculty who 
could function as trainers of other faculty. Moving from the year one model (training faculty to 
utilize a wide range of multimedia equipment and tools to build complete projects) to the year three 
model (training faculty in specific applications) changed the extent to which faculty could act as 
trainers of other faculty at their school sites. The current model focuses on empowering faculty to 
complete technology-based projects for their university classrooms and become trainers of other 
faculty in their academic units, within the realistic constraints imposed in a teaching-centered 
university. 



Introduction 

The constant theme of the past five years has been increasing the use of technology, particularly computer-based 
ones, in education. Many articles and white papers accumulate to create this message with "a new insistence that 
teachers must become technologically literate" (Ely, Blair, Lichvar, Tyksinski, & Martinez 1996, p. 3). 

"Information technologies can so enhance classroom communications and resources that, when properly 
applied, they can transform conventional pedagogical paradigms and create new and powerful contexts for 
learning and teaching. Connected classrooms potentially offer open-ended, dynamic, discovery-oriented 
learning experiences. The more advanced the classroom use of telecommunications is, the greater the 
potential to change the learning environment, the teacher's role in the classroom, the flow of information to 
students and overall classroom dynamics; each can evolve to form more natural and much richer learning 
processes." (Berenfeld 1996). 



In concert with this call for technological literacy is the increased use of multimedia and the WWW in everyday 
society. These two forces serve to create an overpowering impetus for instructors to utilize technology in their 
classrooms. 

However, along with this call to arms is the reality that, in general, college instructors are generally unprepared to 
integrate technology into their classrooms. There is a small (but growing) cohort of early adopters of technology in 
universities but the majority of professors are either non-users or just beginning to explore multimedia and the 
World Wide Web in the classrooms. One of the major reasons for this dichotomy is that technical support for 
university instructors is inadequate. In 1995, the National Academy of Sciences and National Academy of 
Engineering completed a report on the use of technology in education entitled Re-Inventing Schools* the 
Technology is Now. 



Sources of Training for Teachers Who are Familiar with Computers 

PERCENT OF TEACHERS IN SURVEY 

COURSES OFFERED OVER NETWORK Mi 

STATE OR COUNTY COURSES EM 
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INSTRUCTION FROM COLLEGES ! 
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Source: Table obtained from Re-Inventing Schools: the Technology is Now. Available: 
http://search.nap.edu/html/techgap/navigate.cgi 



Statistics shown in this report contain indicate the trend in technology training for teachers. The table above (from 
this report) shows the sources of training for teachers. When teachers were asked what the source of their training 
was (for those familiar with computers) 96% of the teachers surveyed indicated that they had been self taught; 72% 
indicated that conferences or workshops were sources of training, while only 45% indicated that they received much 
of their training from their school district and even less (40%) suggested that their training came from courses within 
the school. 

Although the report, Re-Inventing Schools: the Technology is Now, focused on K-12 faculty, the 
situation is no different among faculty from institutions of higher education. Over the past few years, the number of 
university-level courses with components utilizing multimedia and the WWW has exploded. However, a persistent 
problem still remains: how do you transfer the use of these technologies to “mainstream” faculty? 

Much of the existing training that has been developed is focused on the “innovators or early adopters” of 
technology. A standard strategy of presenting the technology itself and teaching people how to use the technology is 
most appealing and appropriate to faculty interested in technology, the “innovators.” However, mainstream faculty 
have different motivations and reasons for adopting technology as compared to “early adopters. ’ “Early adopters 
and innovators are “techies” who are willing to explore and play with new technologies (Geoghagen 1994). 
According to Freeman, Brimley, and Rosen (1999), mainstream faculty are more likely “to show interest in a new 
technology if it is easy to use and does not require a major change in the skills they already possess.” 

Most universities have established teaching and/or training initiatives related to multimedia and the WWW. 
Many of these initiatives have evolved from training center models — where faculty sign up for pre-established 
“workshops” to learn a new skill. The most successful attempts to equip faculty with the skills and knowledge, as 
well as equipment to create multimedia based learning materials, have occurred where there is a institution-wide 
effort; as demonstrated at Pennsylvania State University with Project Empower Noel and Brannon (1997), with the 
STARS program at Wake Forest (Brown 1999) and outlined in the TESSI Project adopted by the Ministry of 
Education in British Columbia (Woodrow et al. 1997). Unfortunately, not all higher education institutions or 
educational agencies have arrived at this juncture. 



Project Description 

This paper builds upon previous work by Backer and Saltmarch (1999) and describes the results of three consecutive 
summers of teacher training initiatives in multimedia and the Web for the classroom. Sponsored by MASTEP, an 
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NSF funded collaborative to improve mathematics and science teacher education in the greater San Francisco Bay 
Area. 

Summary of First year workshop 

The structure for the first-year training consisted of two one-week “basic” workshops and two three-week 
“advanced” workshops. Workshop participation in the “basic” workshop ranged from 15 to 25 attendees. 
Attendance in the “advanced” workshops was much lower and ranged from 4 to 10 daily. The “basic” workshops 
were very structured and introductory in nature while the “advanced” workshops were project- oriented and open- 
ended in format. The participants who entered the advanced workshops with a clear project idea were most able to 
take advantage of the instructional materials presented during the advanced workshops and were also closest in their 
performance and outcome expectations to those of the workshop instructors. Approximately one-third of the faculty 
attending the “basic” workshops were mainstream faculty while, in the “advanced” workshops, all attendees were 
“early adopters.” 

Many participants in the “basic” workshops were not aware of the state of multimedia technology prior to 
the workshops. They would have benefited by having more time to be “brought into the technology” using an 
approach similar to that developed at Pennsylvania State University through the Project Empower program (Noel & 
Brannon 1997). In our training sessions, as was noted by Oliver and Lake (1997), using technology seemed to 
hinder learning when technical problems arose. 

Many of the participants in the “advanced” workshops also had trouble devoting enough time and energy to 
the workshops since they were not compensated in monetary terms nor were they assigned college or continuing 
education credit for attending the workshops except for the K-12 teachers. The higher education instructors from 
the state and community colleges were taking time from personal projects and other work projects in order to attend 
the workshops at cost to them. Because of these factors, attendance and attrition during the advanced workshops 
was a problem during the latter part of the workshop where participants did not receive formal instruction but were 
expected to work on individual projects. Some higher education instructors looked forward to release time during 
the next academic year to continue the multimedia projects developed during the summer workshops and these 
participants were more motivated to complete their projects. 

Summary of second year workshop 

June Higher Education Workshop 

In all, fourteen faculty (from local Community Colleges and San Jose State) participated in the June 1998 
workshop. Based upon feedback from the first year, we changed the workshop structure to four one-week sessions 
rather than the one- week “basic”, three-week “advanced” model of Year 1. The topics for the one-week sessions 
were: Week 1 Pedagogy, Week 2 Desktop Multimedia, Week 3 Using the WWW, and Week 4 Special projects. 
Workshop participation in the one- week workshops ranged from 4-10 attendees. Most of the workshop attendees in 
the June Workshop were again “early adopters.” 



The attendees of this workshop differed in many respects from the workshops of the previous year. Most 
of the faculty entered this session with highly defined, preconceived ideas of what they wanted to do. Sometimes, 
this led to a conflict between teacher and student expectations; incidentally, this situation was not reflected in the 
teaching evaluations that were excellent. In many ways, students were resistant to any suggestion or teaching that 
did not fit into their paradigm regardless of the need of their design. For example, to engineering faculty members 
attended the June workshop with the goal of designing course Web pages. These faculty members refused to 
participate in any tutorials or class discussions, or learn any software, that was not directly related to their task at 
hand. Although this goal seems acceptable, this resistance precipitated the re-teaching of many concepts and 
software throughout the four weeks. 

July K-12 Workshop 

The July workshop session was structured differently than the June workshop in some respects. This 
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session was again divided into four weeks. However, the fourth week had a different focus (the first three weeks of 
this workshop paralleled the content of the same weeks in the June workshop). The attendees of this workshop were 
all K - 12 teachers who had been selected to receive equipment and software through a proposal competition run by 
MASTEP. All of the workshop attendees in the July Workshop were again “early adopters.” 

The teachers, by their own admission, expected that the workshops would follow a "chalk and talk" format. 
At first, the teachers were dismayed that they had to actively learn and produce tangible products. However, 
compliance to teacher expectations and motivation was high. Also, the students in this section were graded on the 
quality and appropriateness of their outcomes. 

Summary of third year workshops 

After reviewing participant feedback from both years, a consistent thread emerged. The workshop time 
commitment was too great for most faculty. In addition, the researchers were concerned about extending this 
training to mainstream faculty rather than just serving the pool of “early adopters.” It was decided to move to a 
topic-specific training model with short one to four day training sessions. Additionally, over the three year period, 
specific workshop instruction had been transformed from an open-ended, project focus emphasis into a specific 
topic tutorial-based, structured environment. The attendees and other faculty drove this transformation, which began 
in year 2 and was ftilly evident in year 3, interested in the workshops. To meet a trainer of trainer’s objective, each 
topic specific workshops required that a mini project be completed after initial tutorials. Participants, who were 
predominantly mainstream faculty, were very satisfied with this format. 

Summary of Current Training Model for SJSU Faculty 

An original objective of these workshops within the MASTEP Collaborative was directed at providing 
faculty who could function as trainers of other faculty. Moving from the year one model (training faculty to utilize a 
wide range of multimedia equipment and tools to build complete projects) to the year three model (training faculty 
in specific applications) changed the extent to which faculty could act as trainers of other faculty at their home 
school sites. Since complete multimedia or WWW projects normally require the use of various applications and 
equipment, faculty would have to attend a series of topic specific workshops and then attend a separate series of 
project based workshops to assemble a complete desktop or WWW project. The intention of this model is to meet 
the time constraints of mainstream faculty and yet provide the necessary training and project management skills 
necessary to develop a fully realized desktop or WWW project. 
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Abstract: Northwestern University and Deerfield School District 109 in Illinois are 
collaborating on a project that seeks to encourage cross-district collaboration and the sharing 
of resources between teachers and students via the internet. The setting for this initiative is the 
annual school science fair with its broad scientific scope and need for community 
involvement. Northwestern’s Collaboratory Project has developed an internet application that 
is being piloted in classes at both junior high schools in District 109. The results thus far have 
been encouraging and are reported here by a member of the development team and the two 
teachers adopting this technology. 



Background 

The expertise of a university development team gives K-12 teachers the framework 
they need to bring technology quickly and expertly into their classrooms. 

The Leaning Model: A science fair project is a long-term, engaged-learning activity for middle and high 
school students. In some school districts science fair projects are required, promoting the concept that not just 
the scientifically gifted student can gain from the experience of learning science by doing science. In these 
districts it is felt that everyone should have the opportunity to apply the scientific method firsthand. In many 
other school districts throughout the country participation in a science fair is optional but still considered a 
valued learning experience. 

The Collaboratory Project ( http://collaboratory.nunet.net ): The Collaboratory Project is a Northwestern 
University initiative funded by Ameritech Corporation. Its charter is to establish a network-based collaborative 
environment to support education in the greater Chicago area. Collaboratory Project Communities are network 
initiatives that enable people and organizations with common interests to collaborate on projects and share 
ideas, information, and resources. The Collaboratory Project’s most recent collaborative community is "The 
Repository" which is being piloted in Chicago area schools this fall as a science fair resource. 

The Repository: The Repository is a resource for sharing projects on the web. Repository managers define the 
goals of their repository collection, control the available categories, and monitor contributions. Users can search 
repositories by category or keyword, propose new categories, and make contributions from a standard web 
browser. 



Motivations 



I do not want to ask students to participate in a science fair only to see them next on 
the day of the fair. The lines of communication need to be open all the time. 

Getting Started: In the planning stage of the project teachers interviewed pointed to project selection as a 
major predictor of success in science fairs. If students like what they are doing they are motivated to cany out a 
three-month engaged-learning activity, but students and teachers agree that one of the hardest things about 
participating in a science fair is getting started, that is, deciding what to do. 

Many students are eager to do science fair projects when they are first introduced. They welcome the idea of 
being in charge of the design of an experiment and the gathering of data. But, before any of this occurs, they 
must choose a topic. This is extremely difficult for many students. There is such an array of ideas - how does 
one choose a topic? Unfortunately many students decide not to participate because they are struggling to do the 
very first step - choosing a topic or idea. 

Sharing Resources: In Illinois, science fair projects are judged by volunteers from the community who have 
expertise in one or more of the categories of participation. Judges are parents, teachers from out-of-district 
schools, local officials and representatives from local industry. Projects are scored on various criteria including 
a written, visual and oral presentation; display of knowledge gained; command of the scientific method and 
creativity. Projects with the highest scores advance to a regional science fair. 

To judge a regional science fair, the precursor of the state fair, is to experience a vast difference in the quality 
of projects between districts. Indeed one might suspect that different standards had been used, although 
guidelines are clearly defined by the state. Whatever the reason for the poor quality of some projects that were 
judged winners at local fairs, their authors experience a reality check at the regionals. This might be considered 
a good learning experience for them but did they have to wait for the regional competition to see what their 
peers in other districts were doing? Could communication with their peers have turned their efforts into a more 
positive experience at the regional fair? 

This suggests a need for districts to collaborate on this and like common objectives and further implies the 
potential benefit to education in general at the greater community level. The Science Fair Repository was 
conceived with the conviction that the internet held a solution to this problem and could effectively provide a 
way for school districts to share two resources they all possess regardless of budget: knowledge and ideas. Peer 
feedback between districts can only help reinforce student knowledge of standards and comprehension of the 
scientific method. One attribute shared by participants from all districts is effort. They all work hard on their 
projects and it is likely that many students will be better rewarded for their efforts if they have the benefit of 
inter-district collaboration. 

In April 1999 The Collaborator Project introduced a prototype of the Science Fair Repository to a group of 
local K-12 science teachers formally initiating a pilot program with the goal of addressing the problems 
described here. 



The Science Fair Repository 

There was the temptation to call this “Project Paradox” for it has as its focus the 
needs of the individual learner and as its goal access for the masses. 

Vision: The Science Fair Repository is the first incarnation of The Collaborator Project’s repositor 
community. Its vision is that of a large continually updated collection of science fair project abstracts organized 
by scientific categor an d searchable by author, date, categor and keyword. Abstracts are submitted to 
categories by registered teachers and students from around the countr- An abstract is accepted or denied by the 
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manager of the category of submission. A "category manager" is a teacher with expertise in the science fair 
category that is being moderated. Once activated, accepted, the abstract is visible to anyone with a web browser. 
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the track had an angular drop and the other half was flaL 
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The variables tested were: (1) height of track; (2) mass of car; (3) position of mass 
in cars; (4) body style of car and (5)the effect of lubrication. In all, 21 different cars 
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(1) if the mass is placed closer to the front of the car, then the car ’will travel faster 
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Figure 1: A general view of the Science Fair Repository. Category choices appear in the left column with 

login functions for students and teachers with accounts at the bottom. The abstract is viewed in the 
right column. Comments directed to individual abstracts are initiated below the abstract view area. 
(Categories and project sections for the pilot follow the guidelines of the Illinois Junior Academy of Sciences.) 

The Abstract: This is more than a simple overview of the project but less than a complete project paper. It 
includes sections for: the author's name, date of submission, an introduction/overview, acknowledgments, the 
hypothesis, research with sources, materials and procedures, and references. Conspicuously missing are sections 
for "results" and "conclusions". They have been omitted on recommendation of focus group teachers. Virtually 
every teacher interviewed expressed some degree of concern for plagiarism. Most seemed satisfied with this 
solution. A results section with a short "teaser" was generally thought to be an acceptable alternative, perhaps 
even engaging for an interested student. This is one area that will be watched closely during this year's testing. 

Seeding: Before the vision of the Science Fair Repository can be realized it must be populated with a functional 
number of real projects. The core of teachers consulted during last year's development cycle has been asked to 
input, or have the student authors input, abstracts of projects from recent state science fairs. The goal is to have 
several good examples for each science category so that the Science Fair Repository can be demonstrated at this 
year's regional and state fairs in order to generate a significant number of account applications from science 
teachers statewide. 

It is intended that the Science Fair Repository will be sufficiently populated by the fall semester of 2000 to be a 
useful resource for any science student or science teacher with an internet connection. It will expose students in 
search of a "good fit" science fair topic to real projects, written and presented by their peers and predecessors, in 
all represented categories. This will address the issue of student motivation by providing participants with a 
better idea of what they might "like to do". The Science Fair Repository is expected to continually grow and 
update itself as the number of contributors increases, making it a richer resource as time passes. 
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Figure 2: A data entry view for the Science Fair Repository. 



Variations of the Science Fair Repository 

Give a teacher a good idea and the teacher will return the favor. 

The Science Fair Repository was developed as a science fair resource and a project development tool but the 
later function was not scheduled for testing this year. However , both pilot teachers saw this potential and 
asked to employ the tool for this purpose, each with somewhat different requirements for their individual 
programs. The remainder of this document will explore the benefits they expect to derive from the Science Fair 
Repository and will be reported primarily from their points-of-view. 

Pilot A, Shepard: Experiments For Everyone 

At Shepard Junior High School, science fair projects are required of all 7th graders. Ann 
Blythe teaches four 7th grade science classes there and all of her students are using the 
Science Fair Repository to record and report their projects as they progress. Each student has 
been given a semi-private account, visible only to the student and the teacher. This gives Ann 
the ability to monitor the progress of each student and by using the built-in "comments 
feature" she can make private on-line suggestions for individual projects. 

When I was initially approached to become involved with The Collaboratory Project, I viewed this as a vehicle 
to show how middle school students can achieve success in doing a science fair project: one that really involves 
a student, applies the principles of the scientific method, and requires the use of critical thinking/problem 
solving skills. Furthermore, my students would have the opportunity to publish their exemplar projects on the 
web and read the projects of others. I believe that this type of design will assist students in finding quality ideas 
in all fields of science, allow students to work at their own pace, and enable a teacher to work more on a one-to- 
one level with students. 

This project fulfills the needs of both students and teachers. Both parties can roam the site in search of ideas, 
receive self-instruction on the components of a project, along with examples of what that component "looks" 
like. For teachers unfamiliar with how to teach the science fair project process, this site can be the "how-to” in 
preparing their students. The design allows for students and teachers to view how a project flows, keeps 
information in one central area and provides the ability to edit work. Most importantly, it encourages ongoing 
teacher-student communication via a comment field. The teacher can also monitor quality control in 
determining what actually is an acceptable project for the Science Fair Repository. 

My students showed a level of enthusiasm for both working on their project via the web, and viewing their 
school name at the Collaboratory site along with pride in knowing some of Shepard's projects would be viewed 
by the world. My students come prepared when they know we will be in the computer lab and many have 
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worked ahead using the site. For students who are unsure of how to design a component, they can easily 
reference an example or use the menu for extra help. I view this as an universal self-help skill. 

As for my school, it is thrilling to be involved on a project in a pilot role. This is a real "science fair 
experiment" in itself with 1 00 student subjects to provide reliability in the test results. I am experiencing the 
same feelings, learning, and technology obstacles as do my students in this process. This project has benefited 
both my students and myself. I now have a more urgent need for the latest technology and the vehicle for which 
to incorporate it into the curriculum. Our state goals do reflect the ongoing need and use of technology, and I 
know we will meet that standard on all levels. 

Overall, this type of project benefits not only students, teachers and the school, but also the community. Where 
else can they go and view what students are producing at their schools, to see how students use technology, and 
how to arrive at a finished product that undergoes numerous revisions, and mostly importantly, understand what 
students have learned through problem solving? 

Pilot B, Caruso: The Regional Track 

At Caruso Junior High School, the other middle school in the district, science fairs are handled 
quite differently. Here the local school science fair is optional but for students who are 
motivated to go to the next level there is a special Regional Track Program. Beatrise 
Revelins is the coordinator of this program and is piloting a science fair repository that has 
been tailored specifically for it. 

I see the Science Fair Repository as a great resource of ideas, helping students get through the difficult initial 
stage of choosing a topic. Students will no longer have to rely on books that list vague topics such as plants and 
the sun, water pollution, computers, etc. Instead they will see interesting, challenging, and successful science 
fair projects while gaining insight into what makes a project a winner. Teachers will no longer have to struggle 
in finding lists of topics that will interest their students. 

I joined this pilot program for three reasons. First, I saw this program helping me establish another means of 
communications with my students. Experiments are long-term projects that need constant input. 1 do not want to 
ask students to participate in a science fair only to see them next on the day of the fair. The lines of 
communication need to be open all the time. Our school has established a great program for students interested 
in going to a regional science fair. Here the lines of communication have been established fairly well. These 
students are seeing the need for more teacher input. Problems arise, equipment is needed, and charts need to be 
reviewed. Constant input is a must for this type of a high level project to become a success. The Science Fair 
Repository allows these students and teachers to communicate as never before. My second reason for joining 
this pilot program is simple. We would like to bring more students into the science fair and give them individual 
attention. The students who decide to do the "Regular Track" (local fair only) are also in need of more input 
from their teachers. Because this is not a mandatory project, these projects are done outside of school. Many 
students do fine work alone, but more and more are seeking guidance from the teachers. I see this project 
opening the lines of communication to all science fair participants. Everyone receives input and assistance. The 
third reason why I was willing to participate in this pilot program is because I feel we as a school need to bring 
more technology into the classroom. Technology in the class seems to be years behind the rest of the world. I 
want my students to be using today's technology for their projects now. This eliminates paperwork and helps 
students stay more on track. 

Our "Regional Track Program" is very strong. This project will bring it up to date. We can eliminate paperwork 
(project update forms), which can be difficult to keep track of depending on how many students are involved. 
Teacher feedback is now quicker and the organization of the project is more visible. Our district needs to meet 
technology goals within the curriculum. This project is a very powerful tool that will allow us to bring today's 
technology into the classroom. 

One of the most exciting aspects of this project is giving the students an opportunity for another audience to see 
their work. I believe that by showcasing these exemplary projects many people benefit. As students work on 
their projects they know that this will be on the web for others to see. Their audience has been broadened. In my 
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classroom I have mentioned numerous times how scientists strive to publish their findings as soon as they can. 
They know that feedback from their colleagues is priceless. They also seek recognition for a job well done. This 
project gives students that real-life feeling. Students, the young scientists, have completed an experiment and 
are now given the opportunity for their peers and others to see their work and give them feedback. Future 
science fair participants also benefit. In the Science Fair Repository they will find true experiments that work. 
Both parties gain so much. It truly becomes more than a "science fair project for my science class." It is an 
experience that is documented for the world to see. 



Summary 

The Science Fair Repository offers K-12 science educators a collaborative tool with a short learning curve for 
teachers and students. As a resource it offers a solution for the common problem of choosing a science fair 
project. As a organizational tool it can provide improved student-teacher communication throughout the course 
of a long project. In the later application, students can work privately on their projects until completion when 
the teacher can make it viewable to the class and immediate community. This does not replace the poster, paper 
and oral presentations but will provide access to the project for peers, teachers, parents and science fair judges 
long before the actual day of the fair. It promises to divert much of the confusion brought on by papers left at 
home and relieve much of the time constraints placed on judging. 

The topic of a web-based science fair, or cyberfair, arises whenever the Science Fair Repository prototype is 
shown to a group teachers. The Collaboratory Project is not addressing that concept or even suggesting it to 
partner schools at this stage in development. The primary goal, at present, is to deal with the issues expressed 
in this document. Yet it is apparent that the Science Fair Repository may be a first step in this direction for some 
schools. Indeed, in terms of deploying the written portion of a project in web format it is already there. As 
teachers use the Science Fair Repository they will discover new ways to use and improve the product. In 
particular it may provide an opportunity for Mathematics and Computer Science teachers to consider on-line 
options for science fair projects in their fields, which are generally not well represented in local and regional 
fairs. The Collaboratory Project will consider the on-line science fair option when and if this occurs. 
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Abstract: This study examined how elementary children and their classroom teacher 
interpreted a visit to a museum’s science gallery and the videoconferencing link that 
preceded it. The interactive “virtual tour” was meant to serve as an advance organizer 
for the children. This interpretive, non-comparative project specifically involved four 
fifth grade “key informants” and their teacher. Data were gathered through interviews, 
observations, artifacts, and researcher reflections. Individual informant data was 
analyzed for common patterns and compared cross case for synthesis into key themes 
about the nature of the experiences. Data analysis revealed that the students’ learning 
styles and peer group structure had an impact on the nature of their investigations 
during the on-site visit. Also noted was how the videoconference was a successful 
advance organizer. Students were able to create mental organizers, such as mental maps 
and interest agendas, following the link which helped direct and focus their exploration 
during the museum visit. 



Introduction 

Science museums and other informal science centers such as zoos, aquaria, and environmental centers 
have increased in popularity with teachers because they provide opportunities that extend beyond the traditional 
static museum. These types of environments provide direct, interactive experiences with relevant materials that 
enhance students’ curiosity and wonderment about science (Falk, Koran, & Dierking, 1986). Bitgood, Serrell, and 
Thompson (1994) note the advantages that informal learning environments have over the traditional classroom. 
These sites are often able to meld affective and cognitive learning experiences as academic enrichment occurs via 
recreational interactions. Additionally, "time-on-task", while usually short, episodic and more intense than a 
traditional classroom, is controlled by the learner. Thus, participants are more apt to pursue those exhibits which 
possess science content that is relevant and meaningful to them. With this growing utilization of informal 
environments, the assumption would be that the canon of research supporting their use has increased as well. 
However, Schauble and Bartlett (1997) concluded in their search for research-based museum designs that there is 
an incredible discrepancy between research on museums as an actual learning context compared to studies on 
exhibit evaluations within the museum. They also note that even though there are many current sub-fields 
organized around school learning, such as educational psychology and instructional psychology, there is currently 
no sub-field that is generating the constructs and methodologies associated with informal learning. 

Whereas research on galleries designed with appropriate pedagogy is limited, there is a significant 
amount of information on the behaviors children exhibit while attending informal science settings. In particular, 
the behavioral reactions to setting orientation and novelty influence has been examined extensively. This has led 
some researchers to be concerned that the novelty, or excitement of a field trip, may interfere with task-directed 
learning. Children spend more energy orienting themselves with the environment than trying to understand the 
scientific concept being presented (Falk, 1983a). In fact, some studies suggest that extreme novelty could even 
lead to less exploration and fear (Falk & Balling, 1982; Falk, Martin & Balling, 1978; Martin, Falk, & Balling, 
1981). Researchers have conducted investigations to determine if purposeful, novelty reducing procedures such as 
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advanced organizers, or pre-visit, post- visit and on-site visit materials affect students’ conceptual learning. Falk 
(1983b) researched whether orienting materials could be useful in producing more successful learning of museum 
information. These orienting materials include; logistical layouts and agendas given pre-visit, information panels 
placed anterior to museum exhibits, teacher pre-visit discussions, cognitive preparation materials related to the 
exhibits, and slide-tape presentations given pre-visit. 

This last form of novelty reduction provided the catalyst for this study. Kubota and Olstad (1991) 
introduced a pre-visit novelty reducing treatment via a slide tape presentation of the logistics and highlights of the 
science center. Their positive outcomes suggest that two-way audio-visual interactive learning technology could 
produce similar results. However, few projects investigate applications at the high school level and virtually none 
exist for the middle or elementary school (Evjemo, Eidsvik, & Danielsen, 1995). 



The Study 

Objectives 

The purpose of this research study was to examine how children and their classroom teacher interpreted a 
visit to the ScienceWorks Gallery of The Children’s Museum of Indianapolis, and the videoconference pre-visit 
“tour” of the gallery which preceded it. This two-way distance link was broadcasted and received via a statewide 
fiberoptic, videoconferencing network. The “Virtual Tour” was meant to serve as an advance organizer for 
children so that they could better focus on the concepts being presented by museum exhibits. Specifically, the 
study addressed the following questions: 

1. What are children's interpretations of their experience in a novel science museum setting and the distance link 
which preceded it? 

2. What is the classroom teacher's interpretation of those children’s experiences? 

3. How do the children’s and teacher’s interpretation of this experience compare? 



Design & Procedures 

This interpretive study involved four fifth grade children and their classroom teacher as key informants. 
Data was gathered throughout three phases of the study and included interviews with the key informants, 
observations, field notes and artifacts, and researcher reflections. These data sources are highlighted in Table 1. 
The study followed a phenomenological theoretical tradition. According to Patton (1990), the central question of 
phenomenological research is "What is the structure and essence of experience of this phenomenon for these 
people?" (p. 88). The research questions for this study addressed that inquiry as the participants interpreted the 
experience of their interaction with technology and with the museum environment. 

Interviews were utilized as the primary data source. An interview was conducted with each key informant 
following the initial observations but prior to the distance link. A second interview occurs immediately following 
the distance link but prior to the museum visit. The third and final interview sessions occured following the 
experience at the museum. 

The key informants and their classmates were formally observed prior to the visit. This experience helped 
provide general background knowledge on the dynamics of the class, the students, and the teacher. Tracking of the 
key informants was utilized during the actual visit to the museum; assistants recorded information such as the path 
of movement throughout the gallery, exhibits that were explored ("attraction"), amount of time spent at those 
exhibits ("holding power"), interaction with other visitors or classmates, and comments made related to the exhibit. 

The data obtained from tracking were used as one type of field notes. Other field notes included artifacts 
produced by the key informants during interviews. As part of the second interview, the student informants created 
a graphic organizer of the exhibit areas they remembered most vividly. This organizer served as a probing 
mechanism during interview questioning and discussion. A second artifact that was produced during the third 
interview was a color coded “level of interaction” map which each key informant used as a type of self evaluation. 
Each child was given a map of the ScienceWorks Gallery and was asked to color code the exhibit areas according 
to their perception of their level of interaction. This organizer provided a focus piece for discussions related to 
favorite exhibits and science content learned at those exhibits. The tracking records were used in conjunction with 



these maps as they provided a basis for comparison when consistencies and inconsistencies were pointed out to the 
students. 

Personal reflections that followed observations, interviews, the distance link, and the museum visit were 
also recorded. Reflections were defined as interpretations of why students behaved in a particular manner, why 
students responded to various interview questions, what parts of the study went well, and difficulties experienced 
during the study. 



Project Phases and Data Types 
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maps (3 rd interview) 


• following on-site 
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Table 1: The three phases of the study and the type of data collected during each of those phases. 



Data Analysis 

Each student informant interview set was initially examined for patterns in interpretations. These 
patterns were compared with other related data such as artifacts, observations, and researcher reflection. Such 
comparisons were used to either support the patterns or highlight inconsistencies. The teachers interviews were 
not analyzed as an individual set but were used as a means for comparison of the student’s interpretation with her 
interpretation of those students’ experiences. To develop a more comprehensive understanding of the nature of the 
videoconference link and museum experiences, and to provide an anchor for implications, a cross case analysis was 
implemented. This procedure compared the individual interpretation patterns of each of the four student 
informants. From this comparison, a set of key themes specific to five domain areas was determined. These 
themes were examined in relation to the research question, hence, providing the conclusions and implications. 



Findings 

Derin as an Example 

While all four students and teacher informant data were examined for the analysis of the study, the 
following section highlights those interpretations provided by Derin, one of the four student informants. He was 
the most verbal of the four students and hence, provided the richest set of data. Following the Derin interpretation 
is a summary of key points noted from the cross-case analysis. 

Derin approached many of his endeavors in a purposeful and somewhat systematic manner, a trait 
confirmed by his teacher who stated, “Knowing him [Derin] as a student, he’s very detailed in writing and 
sequential” (Interview, 11/18/97).. His ability to make logical connections across learning domains was clearly 
evident. He was capable of establishing relationships and reinforcements between and among his school and home 
environments. In addition to approaching his school science purposefully and systematically, Derin engaged in his 
museum experience in a similar manner. His exploration of the gallery was initiated by a self-orienting session. 
When asked what he did as he first entered ScienceWorks, he replied, “Well, I looked around to see where 
everything was, just to see.. .well, if the pond’s over there, then the crane’s over there. And the pond’s right there, 
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and then the ball machine’s right there. So I kind of worked my way around and then I went to the pond, and then 
to the crane, and then to ...the pond...er, the river, then to the crane, then to the pond “(Interview, 1 1/18/97). 

For Derin, the video medium provided a bridge between the museum and his school. He implied that the 
technology provided almost a seamless connection to the gallery. When ask for a general reaction to his first 
videoconference experience, Derin stated, “I thought is was kind of cool how you could see the person at the same 
time as they were talking. It was like watching someone on TV, but they could see you too. So that was neat” 
(Interview, 1 1/12/97). He compared it to the actual physical context of our interview setting stating, “It’s [the video 
link] like standing right next to someone and talking to them, like this” (Interview, 1 1/12/97). He also noted that 
this interaction allowed him to view the connection as a dynamic, synchronous medium (whereas some of the other 
informants noted how they would slip into a “passive viewing mode”). Derin concluded that these technological 
characteristics provided a unique venue for exposing his class to the ScienceWorks Gallery. According to him, a 
film strip of the gallery or a museum facilitator visiting them on site both have merit, but he would prefer the video 
link, noting, “I’d probably rather do a distance link so they could show you what it really looks like” (Interview, 
11/12/97). 

After the museum visit, Derin was asked to compare the experience in the gallery with the expectation he 
had developed following the broadcast. His response demonstrated his belief that the link was a valuable tool for 
enhancing his experience. He noted, “It [the museum visit] was better than I thought. Cause, I was thinking we’d 
just go through and go to a few different things. But it was really, really neat to be able to be there and do all the 
stuff we seen on TV” (Interview, 1 1/18/97). 

Such reflections would support the canon of research that recognizes the cognitive and affective benefits 
of advance organizers and pre-visit experiences. Additionally, when Derin was asked to compare his explorations 
of other galleries located in The Children’s Museum, he highlighted the orientation which had taken place. “It [a 
visit to another gallery] was not as good as this one because I actually knew what would be good and what to do 
with my time. Cause the other ones, I just had to explore around” (Interview, 1 1/18/97). For Derin, the distance 
link provided him an opportunity to create a mental map of the gallery. 



Cross Case Findings 

The following is a summary cross-case analysis generated from the interpretation of all informant 
interviews and supplemental data. Many of the patterns noted in the Derin data are evident in this analysis. 
Patterns were noted in five domains: Exploration and Interview Style; Science Understandings; Museum 
Experience Interpretation; Videoconference Experience Interpretation and; Relationship of Videoconference 
Experience to the Museum Visit. 

1. Exploration & Interview Style:The examination of the various data set has reinforced a realization that 
in order to properly evaluate and interpret the information, the personal context each student possesses must be 
taken into account. What type of communicator are they? How do they approach their explorations? What types of 
social structures influenced their reactions and behaviors? Such factors had a significant impact on the 
interpretations of their experience as well as how they chose to verbalize them. Two of the students were very 
articulate in their interpretations, while two were quite apprehensive during the interview settings. 

2. Science Understanding: All four student informants believed that their manipulative opportunities in 
ScienceWorks was in some way related to underlying scientific phenomena and concepts. Their proclivity to reach 
those understandings varied. Two of the informants were very capable on drawing upon connections between the 
science they experienced at home, school, and the museum environment. For instance, Derin was particularly apt 
at noting the relationships of science concepts observed in his personal life with those he learned about in science 
class. Some student informants enhanced their explanations by integrating science “jargon”. Finally, this 
experience provided an opportunity for all the students to rethink, reinforce, or refine their current conceptual 
framework related to the host of topics presented via ScienceWorks. 

3. Museum Experience Interpretation: The success of a gallery such as ScienceWorks is mostly due to its 
ability to eschew the traditional static display in exchange for a more active approach that incorporates multi- 
sensory manipulations. Each informant made frequent references to ScienceWorks and other field experiences that 
provided opportunities for engaging experiences. Conversely, as the data noted, static displays which offered little 
opportunity for involvement or simply required a visual or auditory observation did not fare as well as those that 



encouraged touching, moving, or hands-on investigating. Hence, environments that provide relevant, multi-sensory 
experiences are viewed as exciting and inviting places because the encourage active kinesthetic explorations. 

4. Videoconference Experience Interpretation: The use of a new technology for the first time instilled a 
sense of excitement for the students. All informants viewed the videoconference link as an enjoyable experience. 
Adjectives such as “neat”, “fun”, and “cool” were frequently used to describe its nature. Throughout their 
reflections on the video link though, the students tended to separate the audio and video constructs, highlighting 
the uniqueness or importance of each. Not surprisingly, the visual capabilities of this technology seemed to 
initially draw the most discussion. All the students were familiar with synchronous voice communications through 
the use of the telephone. However, each of them noted that the opportunity to have a visual attached to that audio 
was a different experience. This uniqueness stemmed from the realization that the same time they were receiving 
an audio/video signal, they were also sending their own signal to the remote site. The television was no longer a 
passive conduit. Ironically, while a primary goal of this study was to orient the students to the Science Works 
Gallery, another inherent form of orientation needed to first occur. The students needed to make themselves 
comfortable in the presence of the technology. The teacher described her interpretation of how the students were 
not always actively aware that this was a two- way medium. She recalled, “I think they forgot that [they were able 
to be seen], A few of them too, with their mouths, they blurted here or there. Or you would see them suddenly 
think ‘Oh my gosh, oh yeah, we’re being listened to or watched’ and then they would put their hands over their 
mouth” (Interview, 1 1/12/97). This statement demonstrated The teacher’s recognition that students went through 
a period of adapting to the technology before they were able to move on. The students provided insight as to some 
of the features of the technology that were useful in focusing attention beyond the novelty of the experience. For 
instance one student noted that the Picture In Picture of the outgoing transmission aided the awareness of what the 
remote site was actually viewing. The opportunity to ask and answer questions also provided a means of making 
the technology a less intrusive focus of the broadcast. 

5. Relationship of Videoconference Experience to the Museum Visit: The video link provided students 
with an insight into the simulated environment presented by ScienceWorks by enabling them to create mental 
organizers. Two specific organizers were gleaned from these patterns: a logistical or spatial awareness of where 
the exhibit components were in relation to each other (a mental map), and a interest organizer that enabled the 
students to determine the order or hierarchy for which they would explore that environment (a mental interest 
agenda). Many of the students created combination or conglomerate of the two with the main function, as one 
informant creatively iterated, to keep from “going nuts about it”. As previously noted, Derin provided a useful 
example of how a mental logistical map was helpful for him. He explained how, upon stepping into the gallery, he 
initiated a self-orientation session that helped put the various gallery pieces in a spatial layout. As the students 
were aware of their logistical placement, they also utilized the second mental organizer, the interest agenda. Derin 
was forthright in stating how the opportunity to view the gallery prior to actually visiting it enabled him to plan his 
explorations around those exhibits that piqued his interest the most. The teacher shared how the students’ 
reactions to the video link provoked a change in their focus for the trip. She compared it to previous ventures 
when student interest revolved around secondary attributes of the visit, such as travel and food. Finally, the teacher 
summarized the manner in which both mental pre-organizers come together to ultimately benefit the students’ 
experiences. She reflected, “[The video link] just set the tone for the whole trip... It really let them know, ‘Oh, we 
know where were going this Friday. We know what the agenda is. We know what we want to see when we get 
there.’ It really mapped it out well in their mind” (Interview, 1 1/18/97). 



Discussion 

Conclusions 

Even though the goal of this study was to examine the notion of novelty and the role of an advanced 
organizer within an informal science setting, one of the limitations was that it also had an inherent second form of 
novelty, the actual use of the interactive audio/visual technology. Since this form of communication is just 
emerging in the education arena, it is something with which most children and their teachers are not familiar. The 
use of the communication system could have inadvertently influenced the behavior of the children when they were 
exposed to a technology in which "they talk to the TV and it talks back." Students may have focused on the 
novelty of this phenomenon, which could serve as a distraction from the content presented in the distance link 



experience. The interpretation of the data takes into account that the students and the teacher may not have been 
responding to the information presented in the link as much as to the workings of the technology. 

Review of student and teacher interviews suggest that the technology was effective in orienting the 
students to the gallery environment. Such findings would support the core body of research that iterates any type 
of advanced organizer will have some positive cognitive and/or affective outcomes. One of the key informant’s 
comments regarding the type of media used as the advanced organizer provided an interesting finding on the 
nature of such interactive media. All interviewees felt the opportunity to interact with the museum facilitator (who 
led the “Virtual Tour”) added to the excitement of the link and the subsequent trip. When asked to compare the 
distance link with a video-taped tour of the gallery, all informants emphasized that the ability to ask questions and 
speak with the tour guide "on the spot" made the distance link more motivating. These same reflections were 
shared by the teacher who also believed that this was one of her most successful field trips. She felt this is so 
because many of the students came prepared with a plan of action for their visit. 



Implications 

The results and conclusions of this project will help provide a better understanding of how children think 
and learn in informal science settings. It will also help extend previous studies done on novelty reducing 
preparation in informal learning environments. Additionally, this particular project can serve as on one of the few 
studies that examine the outcomes of using distance learning technology in a classroom and in an informal science 
setting. 

The conclusions drawn from the project will have implications for the educational establishment’s current 
push toward the integration of advanced technology in the classroom. It will provide a basis for further studies that 
implement distance learning technology. It will also provide information for schools and museums that are just 
beginning to equip their buildings with distance learning technology. 
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Abstract: AnimalWatch is a mathematics tutor with enhanced adaptive feedback precisely 

tailored to girls’ instructional needs. Three evaluation studies with fifth grade students support 
our hypothesis that adaptive feedback is beneficial to girls’ math confidence. We have also had 
high levels of teacher participation including classroom activities, after-school presentations and 
summer workshops. This paper describes features of the tutor, evaluation studies, work with 
classroom teachers and dissemination activities. 



1 . Increasing Girls’ Self-Confidence in Mathematics 

A major factor contributing to women’s lower participation in science, engineering and mathematics careers 
is that, beginning in junior high school, many girls begin to doubt their ability to learn mathematics (Beal, 1994; 
Seller & Gafni, 1996). As a result, girls are typically more likely than boys to progress no further in mathematics 
than eighth grade algebra, and are subsequently under-prepared for many science and math-intensive majors and 
programs at the university and graduate school levels. 

This project focuses on development of an intelligent tutor to provide effective, confidence-enhancing 
mathematics instruction for girls in late elementary school (Hart et al., 1999). The guiding hypothesis is that 
mathematics instruction in the United States can be completely transformed through the use of instructional 
technology so as to be much more appealing to girls, and in turn, enhance girls’ interest in and preparation for 
math and science careers. 

In contrast to most educational software which is designed primarily with the male user in mind, 
AnimalWatch provides supportive, adaptive and effective math instruction tailored to girls’ interests and needs. 
AnimalWatch accomplishes this via its “student model,” a module that draws on cutting edge techniques in 
artificial intelligence to create a representation of each student’s math understanding. The student model is 
continually updated as the student works on math problems and is used to 1) generate appropriately difficult 
problems and 2) to respond to the student’s errors with customized help and feedback tailored to her or his needs. 
AnimalWatch also engages girls’ interest in math by blending mathematics with environmental biology, the 
science subject that is of highest interest to female students. 

AnimalWatch has been developed with the collaboration of local schools to help students learn fractions, 
decimals and percentages at a 5th-6th grade level. In contrast to common drill-and-practice systems, intelligent 
tutoring systems modify themselves to conform to the students’ learning styles. Once the student demonstrates 
mastery of whole numbers, the tutor presents simple fractional problems that require increasingly challenging 
application of the cognitive subtasks involved in solving the problems (e.g. adding fractions with like 
denominators, adding fractions with different denominators, etc.). 

When a student has trouble solving a problem, AnimalWatch initiates a tutoring interaction with customized 
hints and guidance that helps the student work through the problem. Similar problems involving the same 




subskills are given until the student can successfully work the problems. Animal Watch maintains an accurate 
assessment of the student’s strengths and weaknesses. Online self-assessment surveys conducted as students work 
with AnimalWatch have showed that the tutor generates a more accurate assessment of each student’s abilities 
than the students themselves (Beck et al., 1997). 

Figure 1: Example of addition problem in AnimalWatch 
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AnimalWatch uses Artificial Intelligence techniques for problem generation, hint selection and student 
modeling (Stem et al., 1999). Multimedia is used judiciously to engage the student by animating key concepts and 
providing interactive manipulables based on those used by classroom teachers. 



Figure 2: Example of a hint on a simple multiplication problem 
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2. Features for Girls in AnimalWatch 



When the student logs on, he or she enters an environmental biology storyline in which math problems are 
presented within distinct contexts that unfold as the narrative progresses. Students can select an endangered 
species, such as the Right Whale or the Giant Panda, which includes an initial story context. The student is invited 
to join an environmental monitoring team and engagesin activities to prepare for the trip. 

For example, in the case of the Giant Panda, problems involve research at the library about the Panda’s 
habitat, reading about the birth of a new Panda at the San Diego Zoo, estimates of the expenses associated with a 
trip to China, and analyses of the rate of decline of the Panda population over time, etc. The student model 
estimates when the student is ready to move on to the next environment (e.g., whale-watching vessel; mountain 
terrain trip, etc.). Each math problem includes graphics tailored to the problem, e.g., a map of Cape Cod bay 
showing the migration route of the Right Whale for a problem in which students calculate the fractional progress 
of a pod over the course of a week’s travel. The third context involves a return to the research “base” and 
preparation of a report about the species’ status. 

Hints and instruction screens appear when the student has made a problem solving error (example shown in 
Figure 2). Hints and adaptive feedback have been shown to be especially important to girls, whereas boys retained 
their confidence in math even when working with a drill and practice version of the system that simply presented 
problems and responded to student errors with the message, “Try again.” This gender difference in response to 
different types of feedback is consistent with the theoretical framework: Detailed and immediate help provides a 
critical role for lower-confidence students, many of whom are female, who are quick to assume that they do not 
have the ability to understand difficult concepts. 

The intelligent student model is continually updated based on the student’s ongoing performance. Math 
problems in AnimalWatch are not “canned” or pre-stored. Rather, hundreds of problem templates are used to 
generate novel problems “on the fly.” AnimalWatch currently includes mathematics operations that match those 
included in most fifth grade classrooms: whole number operations (multi-digit addition/subtraction, 

multiplicaton/division); introduction to fractions; addition and subtraction of like and unlike multi-digit fractions; 
reduction/simplification; mixed numbers; introduction to proportions/ratios; and interpretation of graphs, charts 
and maps. AnimalWatch has been implemented in the Java computer programming language inorder to be easily 
disseminated via CD-ROM or the Internet and easily used by most elementary schools. 



3. Project Findings: Evaluation Studies with AnimalWatch 

Results from three evaluation studies will be described. The first study focused on collaborative learning, 
and, consistent with students who worked individually, students who worked with a partner showed significant 
increases in math self concept (Berry, et al., submitted). The increase in math self confidence was observed for 
girls working with a male partner, as well as those working with another girl. In terms of math confidence and 
objective problem solving, these results indicate that girls do well with AnimalWatch even when working with a 
male partner. 

The effectiveness on girls’ and boys’ performance of different types of adaptive feedback was measured in 
June 1999 with three classes of fifth graders. Preliminary evidence showed that highly adaptive feedback is 
especially important to girls: when students worked with a version of AnimalWatch with the adaptive feedback 
“turned off,” girls were more negatively affected than boys. The goal was to identify specific hints and help that 
are most beneficial to girls, particularly those who are at different stages of cognitive development. 

In this study, students worked with AnimalWatch for three sessions over the course of one week. 
AnimalWatch was adjusted to compare responses to different types of hints, such as those shown in Figure 4. 
When the student made a mistake, the system first provided messages with relatively little content, e.g., “Are you 
sure you are using the correct operation?” Low interactive text hints were used at first because nearly half of the 
errors entered are corrected by students on the next try after a simple prompt. If the student kept entering a wrong 
answer, the system presented a hint to guide the student in the whole problem-solving process. At this point, 
AnimalWatch selected randomly either hints that were highly conceptual (see Figure 2) or hints that were more 
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procedural in nature (see Figure 4). Hints also varied in the degree of interactivity required from the student: hints 
that were highly interactive were also highly structured and walked the student through the solution process in 
incremental steps (see examples in Figure 4). We hypothesized these would be more helpful to girls. 



Figure 3: Change in Confidence of Girls and Boys 



Data on math problem solving were automatically collected. Hint effectiveness was assessed by comparing 
the number of errors made on subsequent problems of the same type, the idea being that if a particular hint is 
helpful then the student should be able to to solve a similar problem with significantly fewer errors. 
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Figure 4: Examples of hints differing in interactivity 



To evaluate girls’ reactions to the different types of hints, ratings from a survey were analyzed, in relation to 
gender and cognitive development. In a pre-test session, students’ cognitive developmental stage was assessed via a 
computer presented battery of Piagetian reasoning problems (Arroyo et al,, 1999). Students also completed a 
survey about their AnimalWatch experience, including questions in which they were asked to rate the helpfulness 
of the different types of hints that they saw. The results indicated that, not surprisingly, both boys and girls of 
lower cognitive development needed more hints to solve the problems. However, there was a strong relation for 
girls between their cognitive developmental stage and their views of how helpful the different hints were. In 
addition, hints that were highly interactive (i.e,, structured) were rated by girls as significantly more helpful than 
less interactive hints, and were more effective (i.e,, were followed by fewer errors in subsequent problems), whereas 
there was no relation for boys, see Figure 5. Overall, the results indicated that not only is adaptive feedback 
especially important for girls, certain specific types of feedback are preferred by girls, whereas boys do not appear 
to show such consistent preferences. 

Several evaluation studies showed significant improvements in attitudes towards math (confidence, value, 
liking) after students worked with AnimalWatch (Beck et al., 1999), The goal was to assess the effects of working 
with AnimalWatch on girls’ math confidence. With regard to students’ confidence in math, analyses of variance 
comparing the pre- and post-test data from the Academic Attitudes Questionnaire indicated that working with 
AnimalWatch led to significant increases in students’ math self concept (Figure 3). 




Hnt interactivity 



Figure 5: Gender differences in response to high and low interactive hints 

Analyses of the AnimalWatch survey revealed that students generally rated their experience highly: Means 
range from 3.78 to 4.85 (on a 5 point scale) for questions such as “Would you like to use AnimalWatch again?,” 
“When you made errors, did AnimalWatch give you enough help?,” “Do you think the computer is a good way to 
learn math?.” On the question, “Did you like working with AnimalWatch? girls gave significantly higher ratings 
than boys (mean 4.50 for girls, 4.05 for boys). 



4. Dissemination 



Classroom teachers and teachers-in-training were involved in the design of AnimalWatch and in the 
evaluation studies. Workshops for the participating fifth grade teachers focused on gender equity in math and 
science, as did guest lectures to psychology, education and teacher training programs and three-hour workshops for 
student teachers. 

AnimalWatch received high marks from the teachers, who rated it highly on such issues as appropriateness of 
math topics, sufficiency of help, ease of use, and fit to their curriculum. They also felt that working with 
AnimalWatch would help prepare girls for high stakes achievement tests such as the PSAT or the MCAS (a new 
state assessment test suite in Massachusetts), on which girls typically perform less well in math than boys. All the 
participating teachers volunteered their classrooms as sites for future evaluation studies. 

Teachers responded very positively to AnimalWatch’s ease of use and resilience (i.e., there is little that a 
student can do to “mess up” the computer and thus require teacher intervention). They were very pleased that it 
will run on any platform. 



5. Current Research Issues 

Our primary goal in the project is to help girls tackle increasingly challenging math learning while 
maintaining their confidence in their math ability. The critical mechanism is AnimalWatch’s ability to 
immediately provide individualized adaptive feedback and to pace the difficulty of problems to avoid discouraging 
the student with repeated failures. In particular, we are now concerned with how rapidly AnimalWatch should 
“push” girls through the math curriculum. To address these issues, a mechanism that quickly and automatically 
estimates the optimal sequence and rate of problem presentation for each student is being evaluated. Another goal 
is to add an additional species, with background research and context construction. At the request of many 
teachers, we will add a user feature that would allow teachers to review the progress of individual students after 
each session with AnimalWatch. 

An artificial intelligence learning mechanism that quickly and automatically estimates the optimal sequence 
and rate of problem presentation for each student is being evaluated. However, determining when a student is 
bogged down in problem solving is actually quite difficult, technically. First, the overall skill level of the student 
must be accounted for. If two students are given identical problems, the more skilled student will solve the 
problem more quickly than the less skilled student. Second, there are considerable individual differences in how 
quickly students work. For example, some students navigate the keyboard more quickly than others, some students 
have the multiplication tables memorized (more often, boys) while others prefer to use pencil and paper (more 
often, girls) etc. Any of these factors can impact the time required to solve a problem. Finally, the time required to 
solve a problem is a noisy variable. That is, if a student is given similar problems, he or she may take very 
different amounts of time to solve them. A small mistake at the beginning of the problem solving process can 
drastically impact the time required to solve a problem. All these issues are being investigated. 
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Abstract: The purpose of this study was to investigate the relationship between communication 
and achievement among cooperative learning groups performing problem-solving activities in a 
WWW-based Geometry for Teachers distance education course. This paper presents an overview 
of the preliminary findings of the study. 



Introduction 

As the American educational system enters into the 21 st century it is undergoing an evolutionary change 
more rapid than any change in history. Technologies such as the Internet and World Wide Web (WWW), unknown 
by most a decade ago, are now regularly and increasingly used to meet the demands of an ever-changing educational 
populace. Most universities and colleges now offer courses via distance education, some offering entire degree 
programs completely delivered by distance education. 

The reasons for its growth, particularly at the university level, reflect the evolution of higher education in 
general. According to the Virginia Commission on the University of the Twenty First Century, higher education is 
evolving as follows (Potter and Chickering, 1991): 

• The college will be a network of resources, not a place. 

• Offerings will give students a global, multicultural perspective. 

• Widespread use of new technologies will improve the quality of instruction, increase contact between 
students and faculty, and reduce time, place, and space constraints. 

• Living and learning will be more closely integrated outside the classroom. 

These findings indicate the fundamental, evolutionary changes that are occurring in the form of 
electronically distributed distance education courses in colleges and universities across the country. Indeed, those 
universities, colleges, or departments that do not make this change may find themselves proceeding the way of all 
evolutionary nonconformists. 

A major reason that some institutions of higher learning have resisted the change is the several questions 
they may have concerning this form of distance education. Although the use of the Intemet/WWW to conduct 
courses has been growing rapidly for almost a decade, the study of the use of the Internet as a medium to conduct 
distance learning courses is still in its relative infancy. Several questions have been answered; however, several 
more still abound. 

Interaction between students and between student and instructor has been shown to be an important factor 
in determining the success of students enrolled in distance learning classes. There are several studies that show this 
(Threlkeld & Brzoska, 1994; Coldeway, MacRury, and Spencer, 1980). However, the question of the quality of 
interaction - the intellectual level of the communication that is taking place - and how that effects the success of 
students academically is what this study attempts to answer. 




Context 



Math 527 Geometry for Teachers (http://www.math.montana.edu/~dave/m527/Sp99.htm) is a distance 
education course developed by David A. Thomas for K-12 mathematics teachers pursuing masters or doctoral 
degrees in mathematics education at Montana State University. The course surveys transformation, Euclidean, 
fractal, projective, and hyperbolic geometry using a variety of modeling technologies and texts by Smart (1998) and 
Thomas (1998) and is taught concurrently with an undergraduate on-campus course, Math 329. Students are divided 
into small working groups and assigned weekly tasks. Each task requires students to integrate and apply concepts 
and procedures encountered in assigned readings and exercises, make systematic observations using geometric 
models, write descriptive statements, formulate and test conjectures, and synthesize solutions to complex 
mathematical problems. Group communications take place in an Internet-based conferencing environment, First 
Class Intranet Client . Students use FirstClass' messaging and chat features to negotiate the content, language, and 
format of weekly reports. Equations, graphics, data files, and other elements of routine mathematical 
communication are attached to these messages and downloaded by group members as necessary. 



Subjects 

The subjects of this study were all the students who were enrolled in the Geometry for Teachers course 
offered at Montana State University for the 1999 Spring semester. There were a total of 18 students who enrolled 
and completed the course. Fourteen of the eighteen students enrolled in the Math 329 level of the course, four in the 
Math 527 level of the course. Of the fourteen students who enrolled in the undergraduate section of the course, all 
but one were on-campus students taking other courses at MSU during that semester. These students were typically 
secondary mathematics education majors, although since enrollment in the course is open to any student who meets 
the prerequisites, there were students in other fields as well as mathematics education. All four students enrolled in 
the graduate section of the course were off-campus students, teaching in middle schools and high schools in the 
United States. 

The content of the course was identical. The course was not taught in the traditional lecture setting; 
instead, the course materials were delivered to the students via the Internet through the use of the World Wide Web. 
The students who enrolled in this class were typically secondary mathematics education majors 

During the first week of the semester, the students were placed into four groups of four or five students 
each. One group would consist of the five off-campus students. The other three groups were created from the 
thirteen undergraduate students. The members of these three groups were chosen by matching on prior 
mathematical ability, with gender as a secondary matching variable. Prior mathematical ability was determined by 
the student's college grade point average in all mathematics courses that count towards earning a degree in 
secondary mathematics. 



Description of Treatments 

The study investigated the differences in the content and form of communications occurring among the 
members of the four groups as they worked on and discussed problems in an Internet-based, distance education 
format. The students engaged in a series of weekly small group, problem-solving activities in two electronic 
formats: an asynchronous bulletin board messaging system, and a synchronous chat room. Both formats were 
conducted using the First Class Client sofware, an Internet-based communications software used in all Web-based 
distance education courses taught at Montana State University, 

The Geometry for Teachers course at Montana State University for spring semester 1999 was a fifteen 
week course. During the first three weeks, students were given activities to help familiarize themselves with the 
First Class Client software and other software that would be used throughout the entire course. After this, for eleven 
weeks, the students completed one activity per week working in their assigned groups. For the last week of the 
course, no group activity was assigned; instead the students used the time to complete a final project for the course 
and to prepare for the final test. 

Each week all four groups would work on the same problem, using either the bulletin board or the chat 
room to conduct their communication. These environments were to be changed every two to three weeks, giving 
students a chance to familiarize themselves to both environments. The weekly group tasks were to be addressed 



collaboratively, with each student contributing ideas, responding to ideas, proposing strategies and procedures, 
demonstrating possible solutions for the purposes of feedback, and summarizing and reporting the groups findings. 
A complete record of each group's deliberations was recorded in electronic form using First Class Client's messaging 
and chat tools. Substantive contributions to these deliberations that took place in face-to-face or phone 
conversations were to be referenced and reiterated in the electronic communications of that group. 



Methods of Data Collection 

Achievement was measured by the scores on all group activities, and by the scores on individual's midterm 
and final tests. For the group activities, each member of the group was given the same score providing he or she 
fully participated in the work. Since it is relatively impossible to differentiate achievement levels among individual 
class members through the use of the group activity scores, the midterm and final test scores were used for this 
purpose. 

The intellectual content level of the communication was measured using the Interaction Analysis Model 
(IAM) for examining social construction of knowledge, developed by Gunawardena, Lowe, and Anderson (1997). 
The IAM was designed to measure the social construction of knowledge in computer conferencing. The designers 
of the instrument defined five distinct levels, called phases, of knowledge construction. They are (in hierarchical 
order): 

1 . Sharing/Comparing of Information; 

2. The Discovery and Exploration of Dissonance or Inconsistency among Statements, Concepts, or Ideas; 

3. Negotiation of Meaning/Co-construction of Knowledge; 

4. Testing and Modification of Proposed Synthesis of Co-construction; 

5. Agreement Statements/Application of Newly Constructed Meaning. 

The authors also used the IAM to rate one entire message, rather than different sections of the message as 
belonging to different levels, as done earlier by Henri (1992). According to the creators of the IAM instrument, if a 
message was broken down into units of meaning and analyzed separately, the process by which arguments, 
hypotheses, and theories are advanced would be difficult if not impossible to describe. In conducting this research, 
messages were handled in a manner similar to the intent of the creators of the IAM instrument. Each message, 
whether it be from a bulletin board posting or in a chat, would receive one rating. 

Computer attitudes were measured using the Computer Attitude Scale (CAS) developed by Loyd and 
Gressard (1984, 1987). The CAS is an instrument that measures attitudes towards learning about and using 
computers. The instrument provides scores on four different scales: Computer Anxiety, Computer Confidence, 
Computer Liking, and Computer Usefulness. Each subscale consists of ten items. Students respond to statements 
by selecting one of four responses ranging from strongly agree to strongly disagree. Some sample items from the 
CAS are statements such as "computers make me feel uncomfortable" or "I will use computers many ways in my 
life". Scores can range from a low of 10 to a high of 40. In general, the higher the score, the more positive the 
attitude towards computers. Alpha reliability coefficients calculated for each of the three subscales are very high, 
ranging from .87 to .91. The correlations between the subscales range from .69 to .84. 

Finally, attitudes towards the course, the two treatments (asynchronous and synchronous communication) 
and other attitudes were measured with a survey instrument designed by the researcher in conjunction with the 
instructor of the course. The survey was designed to illicit responses both open ended, and using a Lykert scale for 
statistical comparisons. 



Results 

Note: Since the data is still being analyzed, many of the results are still pending; they should be ready by 
the time this paper is presented during the conference. However, there are some preliminary descriptive results of 
data analysis, which will be presented here: 



Computer Attitude Scale 



The results of the CAS, administered during the first few weeks of the course, showed that most students 
had a very positive attitude towards computers. Indeed, some students registered the highest score possible on the 
test. Only two students could be put into the category of having a neutral attitude towards computers. Those two 
students were also the only two students who were relatively new to computers, having experience with learning 
about or working with computers of less than six months. When examining the subscales, they were found to both 
have positive attitudes towards computer usefulness, and computer liking, with neutral attitudes on the computer 
confidence subscale. One of these two students also recorded a neutral attitude on the computer anxiety subscale. 
No students were found to have a negative attitude towards computers. 



Messaging and the Interaction Analysis Model 

During the semester, a total of 740 individual bulletin board messages were posted. Given that there were 
few messages sent during the first few week (when students were familiarizing themselves to the software), and few 
messages sent during the last week of the course (when students were studying for finals), the average of almost 50 
messages a week is fairly impressive. Of these messages, 88 were sent by the instructor of the course, leaving a 
total of 652 total messages sent by the students. 

The content of the course covered six different geometry topics. They were (with the number of weeks 
spent on each topic in parentheses): Transformational Geometry (2), Euclidean Geometry (3), Fractal Geometry (2), 
Inversion (1), Projective Geometry (2), and Hyperbolic Geometry (2). The total amount of messages posted for 
each topic area is given in Table 1. It can be seen that the number of messages varied from topic to topic; but the 
general trend in both student and instructor messages was a decline in the total amount of messages sent. 



Topic 


Total Messages 


Instructor Messages 


Student Messages 


Transformational Geometry 


194 


27 


167 


Euclidean Geometry 


197 


21 


176 


Fractal Geometry 


128 


15 


113 


Inversion 


37 


2 


35 


Projective Geometry 


101 


10 


91 


Hyperbolic Geometry 


83 


13 


70 


Total: 


740 


88 


652 



Table 1: Number of Messages per topic 



The number of messages also varied widely among the problem-solving groups. Each of the four groups 
was identified throughout the course by a color; Red, Blue, Green, or Yellow. The first three groups listed were the 
on-campus groups, with Yellow representing the off-campus group. The total messages posted by each group is 
shown in Table 2. Not surprisingly, the off campus group had a large percentage of the messages posted. 



Group Name: 


Total Messages 


Percent of Total Messages 


Red 


33 


5.06% 


Green 


184 


28.22% 


Blue 


78 


11.96% 


Yellow 


357 


54.75% 


Total 


652 


100% 



Table 2: Number of Messages per group 



Each of the 652 student messages was analyzed using the Interaction Analysis Model. A summary of the 
scoring for each message based on group affiliation is shown in Table 3 and Table 4. A rating of no score was given 
to messages that did not fit into any of the phase levels of the Interaction Analysis Model, such as personal 
messages. In general, both the number of messages and the percent of messages should be higher in the lower 
phases, and lower in the higher phases. This did occur in some instances, but the pattern didn't follow the predicted 
path entirely. Some theories regarding why this occurred are discussed in the next section. 



Group 


Phase 1 


Phase 2 


Phase 3 


Phase 4 


Phase 5 


No Score 


Total 


Red 


17 


5 


7 


2 


1 


1 


33 



best COPY 



fUAU-AB'-E 



no 



Blue 


54 


21 


65 


14 


15 


15 


184 


Green 


31 


4 


17 


1 


16 


9 


78 


Yellow 


149 


40 


77 


24 


19 


48 


357 


Total 


251 


70 


166 


41 


51 


73 


652 



Table 3: Number of messages for each phase level 



Group 


Phase 1 


Phase 2 


Phase 3 


Phase 4 


Phase 5 


No Score 


Total 


Red 


51.52 


15.15 


21.21 


6.06 


3.03 


3.03 


100 


Blue 


29.3 


11.4 


35.3 


7.61 


8.15 


8.15 


100 


Green 


39.7 


5.13 


21.8 


1.28 


20.5 


11.5 


100 


Yellow 


41.7 


11.2 


21.6 


6.72 


5.32 


13.4 


100 



Table 4: Percent of Messages for each Phase Level 



Statistical analyses of the data are currently underway, and will be presented in full at the 2000 M/SET 
conference. 



Conclusions 

As the course progressed, the total number of messages posted by the groups and the instructor tended to 
decline. This could be due to several factors. As the students became more familiar with the context of the course, 
with what was required for each activity and assignment, with the software they were using, and in general with 
each other, questions and statements of this nature decreased. This would also account for a majority of the decrease 
in instructor postings. Also, as the course progressed the students familiarized themselves with division of labor for 
the activities, and became better at asking and answering questions about the activities. Perhaps a third reason could 
be found in the medium itself. For most students, using First Class Client to conduct these group problem-solving 
activities was new, and probably fairly exciting. As that excitement wore off (and the daily grind of the semester set 
in) the urge to post would not be as strong. 

The Yellow group - the group whose members were located off campus - had by far the most postings, 
more than the other three groups combined. This is not entirely surprising - since it was impossible for them to have 
any face-to-face contact of any kind, they needed to conduct all of their communication on-line. The other three 
groups, while working on the activities on-line still could, and did, take advantage of their situation and would meet 
to discuss the problems assigned for the class, including the group activities. To restrict them from doing so would 
have been an unnatural course of action. Hence, the postings from these groups were quite a bit less. 

As tables 3 and 4 indicate, the most common phase was phase 1: Sharing and Comparing Information. 
This is to be expected; in order to solve most problems using a group effort, the knowledge of each member of the 
group will need to be shared among the group's members. Opinions about potential solutions (without any additions 
or deletions), another common posting, also fall into this category. 

However, the strength of Phase 3 messages (Negotiation of Meaning/Co-construction of Knowledge) over 
Phase 2 messages (The Discovery and Exploration of Dissonance or Inconsistencies among Ideas, Concepts, or 
Statements) was surprising. For one group, the number of Phase 3 messages was higher than even Phase 1 
messages. A partial explanation could be that the on-campus groups solved much of the dissonance by either talking 
to the instructor about the problem, or meeting with other group or class members to discuss the problem. Then, all 
they would post was the results of this discussion (the construction of knowledge) - not the steps it took them to 
arrive at the results. However, the completely off-campus group had similar results. This could be due to the use of 
the instrument by the researcher. However, it could also be a result of the nature of mathematics (and 
mathematicians). Unlike a more social, discussion based subject, where dissonance and exploration of ideas are 
brought to the surface and discussed, most of the dissonance in mathematics (for most mathematicians) occurs 
internally. Most mathematicians are not likely to discuss a problem unless they believe they have a potential 
solution to the problem. Thus, most of Phase 2 would occur within the mathematician's mind; he or she will then 
divulge what they think is a possible or partial solution, which would fall into the Phase 3 category. More studies 
would be necessary in order to answer this question fully. 

This could also explain why there are more messages falling into the Phase 5 (Agreement 
Statements/Appli cations of Newly-Constructed Meaning) category than Phase 4 (Testing and Modification of 





Proposed Synthesis or Co-Construction), although it should be noted that the difference is small. Rather than testing 
the proposed construction externally, mathematicians will test it internally, then pronounce it fit and apply it to the 
situation (Phase 5) or find errors in it, and revert back to a Phase 2 or Phase 3 situation. 

It has been shown that communication is one of the keys to success in a distance learning course. But 
communication for its own sake - the solution is probably not as simple as that. The study of how groups 
communicate on-line, and what constitutes effective communication, holds the promise of discovering the best 
possible way to design and implement a web-based course. 
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Abstract: For the past year, a team of six faculty from the College of Natural Sciences at 
California State University, Chico have been working on the NSF-funded development of 
integrated science materials employing a problem-based approach and infusing computer 
modeling and simulation with traditional laboratory experimentation. This paper will report on a 
one-semester course we have developed based on the theme: Global Warming - Should We 
Worry? The course covers topics such as: an introduction to climate change with web-based 
research, an introduction to computer modeling and simulation using the program Stella, and a 
series of modules. Solar Radiation and The Earth, CO2 and The Ocean, and Photosynthesis and 
Respiration, where computer models are developed tied to pertinent laboratory experiments. The 





course concludes with student teams taking on the task of representing various countries or 
regions of the world in a mock Kyoto accord. 



Introduction 

Three major issues in science education are the use of educational technology, problem-based learning, 
and the teaching of science in an integrated format. While the use of technology in the classroom has been 
growing rapidly and recognition of the effectiveness of active, problem-based formats is spreading, implementation 
at most campuses is still piecemeal. The third issue of employing an integrated format is gaining momentum and 
has received national attention from professional organizations and funding agencies for the past several years. 
Change, however, is difficult due to the entrenched structure of single discipline-based instruction. 

California State University, Chico, is considered as a leader in the 23 campus California State University 
system in the implementation of educational technology. What we are in the process of doing now, with the 
assistance of a National Science Foundation grant through the Institutional Reform of Undergraduate Education 
program, is enhancing the entire basic core science curriculum with educational technology using a problem- 
solving, computer simulation, and integrated science approach. It is our aim that early in their education students 
will have the opportunity to see that the sciences have many commonalties, such as, the scientific method, a need 
for quantifiable and verifiable data, and the use of statistics and probability. Most importantly, all the sciences 
require a healthy skepticism tied to 'the process of critical thinking. Our goal is to have student teams investigate 
and model complex problems involving current scientific controversies of national importance chosen specifically 
to require knowledge and skills drawn from many different scientific fields. 

Presently, a student, whether a science major or not, receives an introduction to college-level science by 
taking a basic science course in one discipline, be it chemistry, biology, physics, or geoscience. It is perhaps only 
after several courses and years that students begin to be able to integrate knowledge across the sciences and see a 
more authentic process of doing science. If they only take a couple of courses, they may never see the big picture. 
An integrated approach to science is needed and the best way to accomplish that is for faculty from different 
disciplines to work in teams. It is our hope that by paving the way with a substantial development of resources and 
through faculty training, we can invite more faculty to jump on board, promote a cross-discipline, team teaching 
approach and, thereby, revitalize the core science curriculum with the latest in educational technology and 
pedagogy. 



A Problem-based, Integrated Science Curriculum 

For the past year, a team of six faculty from the College of Natural Sciences at California State University, 
Chico have been working on the NSF-funded development of integrated science materials employing a problem- 
based approach and infusing computer modeling and simulation with traditional laboratory experimentation. One 
of our long-term goals is to develop a library of curricular “Modules” centered on interdisciplinary scientific issues, 
which could be packaged into semester and yearlong integrated general education science and critical thinking 
courses. The NSF grant, also, has helped to fund the remodeling of a classroom into a modem and effectively 
designed combination class/computer laboratory. In addition, we were able to purchase and construct science 
equipment, which will effectively promote our underlying teamwork and hands-on approach. This semester, we 
are conducting faculty workshops to highlight our accomplishments and train faculty in the use of our materials 
and the use of equipment in the newly remodeled room. 

Currently, we have completed materials for a one-semester course based on the theme: Global Warming — 
Should We Worry? Global warming is an ideal “big” issue with plenty of national attention, relevant to the lives 
of our students, contains heavy doses of math and science drawn from numerous disciplines, and is steeped in 
debate over political and social side issues. Other topics under consideration and in various stages of development 
are origins & evolution, watersheds, wetlands, and pollution. 

The section below briefly covers some of the pedagogy and student activities comprising our course on 
global warming. 



Global Warming - Should We Worry? 



In an attempt to incorporate the latest educational pedagogy and provide for effective student and program 
assessment, we have researched the literature on program development and course design. As described in 
(Wiggins & McTighe 1998), we developed our course through the following three steps. First, we identified our 
course objectives. Then, we addressed how we would know if students have met these objectives, which formed 
the basis for developing a series of rubrics as assessment tools. With these two important foundations in place, we 
began the process of developing the student activities. A brief overview of our course, beginning with course 
objectives, a course outline by topics, student assessment, and course evaluation, is given below. 



Course Objectives 

In switching from a content driven to a problem-based course, considerable thought went into identifying 
our goals and expectations. The following three objectives illustrate our emphasis on the process of doing science 
more than developing a storehouse of scientific facts. 

1) Students can critically discuss contemporary scientific issues. 

2) Students demonstrate proper use of scientific method. 

3) Students can make informed decisions involving science and society. 



Course Outline 

I. Global Warming - What’s The Big Deal? 

This unit serves as an introduction to global warming with web-based research using a web site we created 
containing numerous links to interesting pro/con debates and various climate change organizations (the URL 
for this site is given at the end of the paper). The primary objectives in this unit are to introduce students to 
the issues that are part of the global warming controversy, to expose them to several different points of view 
about the controversy, and to leam how to critically evaluate a web site. The main student activity for this 
unit is a site review assignment where students will examine various web sites and then write a paper 
critically evaluating a web site of their choice. 

II. An Introduction to Computer Modeling with Stella 

The primary objectives in this unit are to introduce students to the computer modeling and simulation 
program Stella and to develop a “systems thinking” approach to the modeling process (a URL for 
downloading a free run-time version of this program is given at the end of the paper). Students will 
investigate simple systems, such as, population models and draining sinks, as they leam how to use the model 
creation tools, incorporate mathematical relations defining the interconnections between model components, 
and analyze and evaluate models through simulation. The unit will conclude with a modeling project where 
students will attempt to incorporate additional features in previously developed models. 

III. Solar Radiation and the Earth 

In this unit, students will begin creating a model for the global mean temperature of the surface of the earth. 
The focus will be on the flow of solar radiation and how it effects the temperature of the surface of the earth. 

It is expected that their model will evolve substantially as their understanding of these various science issues 
grows. There will be several opportunities to connect simulation activities using their computer models with 
traditional experimentation through experiments covering such topics as measuring the solar constant, 
discovering the Stefan-Boltzmann law, specific heat capacity measurements, and determining a planetary 
albedo. The unit will conclude with student teams giving oral reports over the development of their computer 
models and its evaluation along with design of experiments and data analysis. 
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IV. C0 2 and the Ocean 

The main objective of this unit is to have students extend their previous model for the global mean 
temperature of the earth by incorporating the role of C0 2 in the atmospheric absorption and emission of 
radiation and the role of the ocean in the uptake of C0 2 . One of the key activities in this unit will have 
students design an experiment for measuring the solubility of C0 2 . 

V. Photosynthesis and Respiration 

In this unit, students will continue the process of extending their model by investigating how the atmosphere 
and biosphere are linked through photosynthesis and respiration. They will learn how these processes can be 
measured and be introduced to equipment for calculating C0 2 exchange rates. Some of the main experiments 
in this unit will be to investigate the influence of temperature, light, water, and atmospheric C0 2 on 
photosynthesis. 

VI. Science & Society 

The course will culminate with a mock-Kyoto accord meeting where student teams will represent various 
nations or regions of the world in coming to a consensus on identifying the dangerous issues of global 
warming and what to do about them. Students will then be responsible for writing a news article debriefing 
VIP’s of the accord and defending their stance. 



Student Assessment 

In each of the units described above, there is one or two main activities involving a mix of individual and 
team papers, team oral reports, designing experiments, team reports on creating, testing, and evaluating models, 
and some traditional quizzes. For each of these main activities, we have identified our objectives and developed a 
grading rubric, which is given to the students at the beginning of the assignment so they will know right up front 
what is expected for various levels of assessment. 

To illustrate the style of our assignments and rubrics, given below are abbreviated versions for the opening 
web site review assignment and the capstone Kyoto accord paper. 



Web Site Review Assignment 

For this assignment, you are to critically review a web site focused on the global warming controversy. 
Your review will be posted and used by the other students in the class as a resource for projects later in the 
semester, so it is important that you produce a review that will be useful to your fellow students. Links to some 
sample sites are given below, although, you are welcome to search for any other useful sites that might be out there. 
Reviews should include a summary of the material available at the site, an evaluation of the quality of the material 
(how much is there, how accurate is the site information, how useful will the site be, etc.). You should also 
evaluate the site for ease of use and discuss the biases of the authors of the site and any bias you find in the 
material available at the site. You should describe your point of view and any bias that you might have. This 
should all be written up in a concise and clear one page electronic paper and is due Feb. 1. The review is worth 10 
points and will be evaluated for the following characteristic: 

• Has a comprehensive description of what is available at this site 

• Has an analysis of the quality and utility of the site 

• Makes comparisons between this site and others and is able to evaluate this site’s contribution to 
illuminating the issue of global warming 

• Includes a clear description of the student’s understanding of the global warming issue and the 
student’s point of view on this issue 

• Paper is clear, concise, and demonstrates critical thinking 



Kyoto Protocol Paper 

The Kyoto Protocol is an agreement among several countries to reduce the environmental contributors to 
global warming. Each country, developed or developing, has a unique set of factors to contend with, such as, its 
geographic location, natural resources, infrastructure, economy, political environment, present atmospheric 
conditions, and production of greenhouse gases. Every country will have to approach the solution to the problem 
of global warming in a different way. Your assignment is threefold: 

1. Read the Kyoto Protocol. 

2. Choose a country and, based on the pertinent characteristics of that country, develop amendments to 
the protocol that would be more favorable to you, but with the understanding that the goal remains to 
reduce greenhouse gas emissions. Pretend you are writing a report to debrief VIP’s of your country of 
your stance on the issues of the Protocol and justifying your amendments. 

3. Determine what your actions and timelines, as this country, would be to implement the protocol if none 
of your amendments were accepted and you followed the stipulations of the protocol. 

Your paper will be assessed on the following: 

• Able to thoroughly explain the meaning and significance of the Kyoto Protocol 

* Understands thoroughly the terminology in and of the Protocol 

• Demonstrates an understanding of the economics, stage of development, environmental issues, and 
political pressures of the countries involved 

* Clearly articulates the represented country’s unique needs, position, and characteristics 

♦ Paper is clear, concise, and demonstrates critical thinking 



Course Evaluation 

This is an area still under development but the following are some ideas we have that directly relate to our 
course objectives. 

* Critical discussion on scientific issues: We will make an initial versus final paper comparison. At the 
beginning of the course, a questionnaire/paper containing some directed questions will be given. This 
will be compared with a final summary report going into each student’s portfolio to assess the growth 
in their ability to discuss the issues involved in global warming. 

* Proper use of the scientific method: We will use a pre-post test comparison along with a beginning 
versus final design of experiment comparison. 

* Making informed decisions on science and society: We will use a video tape of the Kyoto accord 
meeting and Kyoto Protocol paper to assess the decision making processes students incorporated in 
reaching their consensus. 

We are currently consulting with in-house faculty whose area of expertise involves student and program 
assessment to add to and refine the components outlined above. Two other items we intend to include to aid in 
these areas are the use of portfolios and an attitudes survey. 

Given below are some URL’s for our global warming web site, providing a link to download some of our 
finished Stella models, and where to download a demo version of the Stella program to run theses models. 

Our CSU, Chico web site on Global Warming 

http://www.csuchico.edu/~ibell/GlobalWarming/ 



Information on Stella and free run-time versions 
Stella Home page: http://www.hps-inc.com 

Free run-time versions: http://www.hps-inc.com/products/stella/free runtime/runtime. html 
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Abstract: This paper is a preliminary report discussing initial results of the five year 
Partners in Science project Partners in Science is a project linking K-12 students and teachers with 
practicing university, industry and agency scientists using networked technology, with the aim of 
increasing the practice of authentic, project-based math and science. The project’s goals are to: 

1) Improve the student’s understanding of science by designing and conducting their own research; 

2) Effectively utilize technology as a part of the learning and teaching of science and mathematics; 

3) Bring active scientists into the teaching and learning process, both in and out of the classroom. 
Research data gathered from teachers, students, and scientists indicates that the project shows 
promise in each of the three areas. 



The Planning Grant (1995-1997) 

Partners in Science began as a planning grant in 1995. During this planning year, the 
project began to take on a structure, recruited a board of directors, hired a project administrator, 
selected a pilot school, and installed computers and peripherals. The emphasis of the project 
during that year was the application of networked technology for the improvement of math and 
science achievement in Fairbanks and remote village classrooms. The planning grant funded a 
project administrator and the technology hardware for the teachers. There were three sites: an 
elementary school in Fairbanks, a K-12 school in McGrath, Alaska, and an elementary school in 
Grayling, Alaska, as well as five home school students living in the Fairbanks North Star 
Borough. 

In the fall of 1996, the project received a second year extension of the grant and added 
one new teacher to the project in Fairbanks. Staff development during the first two years (1995- 
1997) of the planning grant focused on technology. The grant funded computers, monitors, 
modems, color printers, scanners, video, and digital cameras for each site. It took most of the 
first year to order and install the hardware and equipment. Teachers needed a great deal of 
support just to use the hardware, but there were no trainers during that time. Initially, fifteen 
computers were set up at Pearl Creek Elementary School (PC) in the “V irtual Math Science Lab 
(VSM),” a separate room that was a good distance from the two Partners in Science classrooms. 
Accessibility was a significant issue. Teachers found it difficult to make time to get down to the 
computer lab on a regular basis. Frustration with the technology remained at a high level 
throughout the first year and one-half. Because of this, at the start of year two the VSM Lab 
became the Partners in Science office and all the computers were divided among the teachers and 
located in their classrooms. There were still problems, though, because connectivity to the 
Internet in the classrooms was not as good as the lab, so the machines kept freezing. E-mail was 
used only sporadically during the first years for pen-pal type communications with the Partner 
scientists. When students did use the Partners in Science listserv or e-mail to research a question, 



the questions were of a level that students could have easily researched the questions themselves 
using the Internet or books. Scientist responses were direct replies to the questions. There was no 
attempt to initiate a dialogue and start the students thinking. 



The Implementation Grant (1997-2000) 

In February of 1997, the NSF funded the Partners in Science project as a research project 
for an additional three years. The charge was to research different models for integrating 
technology and collaborations with science, engineering, and math professionals into K-12 
classrooms and home schooling. The primary goal was to further math and science learning in 
grades K-12 in the Fairbanks North Star Borough School District, Iditarod Area School District, 
and isolated home schoolers. The secondary goal for the project was to document the successes 
and the failures of our efforts to support math and science learning in K-12 classrooms in Alaska, 
so that they could be shared with other school districts interested in doing the same thing. 

Additional teachers were selected, three from Fairbanks and a teacher from Shageluk 
School in the Iditarod Area School District. The project hired a half-time administrator in 
McGrath and a half-time secretary, and two trainers, one for technology and one for science and 
math. The additional staff provided the ability to intensify the focus on the project’s goals in staff 
development, as well as the opportunity to look closer at the project’s progress through formative 
and summative assessment. 

Under the research grant, teachers were expected to receive at least seventy hours of staff 
development a year. The focus of that training began to evolve almost immediately from 
technology to a more integrated approach to staff development based on the needs of the teachers 
and the expanded goals of the project. Three tiers were identified to provide a platform for the 
evolving staff development needs. Tier I teachers were to receive basic staff development in 
technology and methodology, as well as a scientist partner. Tier II teachers were to have 
continued staff development and a partner, but staff development would include inquiry 
strategies and project learning. Tier III teachers received only fifty hours of instruction with the 
goal of becoming mentors. Teachers moved up the tiers only when they were ready. It was 
expected that some teachers would remain at Tier I all three years. While this sounded good on 
paper, the teachers never fit into these boxes. So, with the exception of scaling down staff 
development for Tier III schools after their third year, this plan was never implemented. 

The project continued to evolve as teachers, staff, and scientists pursued a deeper 
understanding of teaching and learning. By the fall of 1997, the project had a four- fold focus for 
staff development. “Partners in Science is a project to link K-12 students and teachers to 
practicing university, industry, and agency scientists using networked technology, with the aim 
of increasing the practice of authentic, project-based math and science”. The project had evolved 
from a focus on technology into a broader vision of support for math and science learning and 
teaching. To accomplish this new vision, staff development during the 1997-1999 included the 
following strategies: 

1 . Team-teaching lessons in the classroom with the teachers and scientists 

2. Modeling lessons in the classrooms 

3. Providing a three-day GLOBE (Global Learning Observations for the Benefit of the 
Environment) 

4. Workshop Sharing resources (books, materials, equipment) to teachers on request 
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5. Other miscellaneous staff development opportunities on an individual basis 

In the fall of 1997, the project experienced another significant change. The School District 
Curriculum Director contributed Eisenhower funds to support six additional teachers to attend 
the monthly staff development days. This doubled the number of teachers in attendance at the 
workdays. 

Evaluation during the 1997-1998 school year continued with all the key elements from the 
implementation grant, and the following elements were added: 

• A performance instrument 

• A new attitude instrument 

• Student, teacher, scientist, and trainer journals 

• Teacher-made assessments 

• Regular interviews with students, teachers, and scientists by the local evaluator 

• Regular observations by the local evaluator. 

The project schedule for 1998-1999 was very similar with a few important exceptions: 

• The GLOBE course for teachers was moved to August 

• The original external evaluator was replaced with a local evaluator 

• Partners in Science staff flew to Iditarod schools three times to deliver staff development on 
site rather than flying the teachers in to Fairbanks 

• Staff development was held one day per month and attendance was required. 

• Science content courses (chemistry, ecology, physics) were offered to teachers in June 

Staff development during the year was determined by a needs assessment given to the teachers in 
the fall. Teachers selected the following staff development items on which to focus for the year: 
Science content, Learning Cycle model, GLOBE, Process skills, and Technology. 



Project Completion (1999-2000) 

The Partners in Science project will continue through the end of the 1999-2000 school 
year. It is expected that new teachers will be added and goals and strategies will continue to 
evolve as students, teachers, scientists, and staff, continue to collaborate in an effort to better 
understand learning and teaching math and science. In order to support that process of 
understanding, qualitative and quantitative data will continue to be generated until the 
termination of the project. It is expected that exploring the evolving patterns and themes over a 
period of several years will contribute additional understanding about the project. During this 
final year we will be seeking strategies that will support the sustainability of the philosophy of 
the project in Fairbanks after the NSF funding ends. 
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Evaluation 



The project’s evaluation (thus far) is based upon quantitative and qualitative data 
gathered during the 1997-1998 and 1998-1999 school years (a third year 1999-2000 will be 
incorporated following the end of the 1999-2000 school year). Qualitative and quantitative data 
are being used because they proved complementary in supporting and extending our 
understanding of the complex teaching/leaming process that is occurring in the Partners in 
Science classrooms. The principal questions addressed by this research are: 

• How does the Partners in Science program support students, in project classrooms, to 
leam and apply science inquiry skills and key content concepts? 

• What can count as evidence of student learning of these science inquiry skills and key 
content concepts? 

The data taken as a whole suggests that the presence of the Partners in Science partner 
scientists, staff development, and technology provided by the project may have supported and 
extended learning in the project classroom by providing on-going support and introducing new 
content and methodologies that would not have otherwise been there. There was, however, 
considerable variation across the project classrooms as each partnership and classroom evolved 
uniquely while teachers, partner scientists and students constructed new ideas about science, 
teaching, and learning. This variation, itself, was an important factor in supporting and extending 
understanding of the Project, but made any sort of generalization inappropriate. 

It was also hoped that the assessments would inform the project about the second focus 
question, what could count as evidence of learning in Project classrooms. For this purpose, 
teachers and staff conducted and collected a variety of assessments. The analysis of the data 
generated seemed to support the literature about the value of collecting assessment data through 
a variety of methods in order to provide all children with the opportunity of showing what they 
knew and could do (Gardner, 1993). Because teachers were encouraged to try a number of 
diagnostic, formative, and summative assessment methods, the study benefited from their 
successes and failures, as well as the triangulation across a variety of sources. 

Assessment methods other than the Attitude Assessment seemed fairly consistent in 
helping inform the project about what and how the students were learning. It is important to note, 
however, that no method was universally effective for all students. Each assessment method 
worked in certain situations and with certain students, but not in others. It will be important for 
Partners teachers to consider this when designing their assessment plans in the future. 

The process of data generation (assessment), itself, shaped and informed the project. 
Teachers gathered more formative assessment than they had previously in an effort to support the 
study. They also journaled regularly for the first time, reflecting on how they and their students 
were doing during the change process. 



Qualitative Data 

Qualitative data collection supported and extended the understandings that emerged 
during the study. In particular, it appeared that the variety of assessment methods and contexts 
across the project proved especially beneficial for understanding what students were learning in 
the complex and evolving classroom environments. Several methods proved especially valuable 
formatively and summatively across all participants and context, in particular interviews, journal 
entries, and teacher-designed assessments. 

All interviews for this report were semi-structured in nature. The data generated from the 
interviews supported the large body of research suggesting that semi-structured interviews were 
valuable for developing an understanding of the interviewee’s perspective. Interviews apparently 
provided an important opportunity to understand the thinking of students who could not or did 
not express their understandings fully in writing. In a number of cases, indications of concept 
development appeared in interviews and nowhere else. The exception to this was the middle 
school interviews, which will be discussed thoroughly in a following section. There was no 
obvious evidence of reflexivity (saying what interviewer wanted to hear). In fact, the honesty of 
participants during the interview process was influential in the evolution of the project. 

Journal entries appeared to be equally valuable and outspoken. They were especially 
informative for children and adults who were comfortable expressing their ideas in written form. 
In several significant cases, however, student journal entries indicated little concept development 
while other non-written sources of data contradicted this by showing good concept development. 

Teacher-designed assessments were the final important category of evidence of learning 
to emerge from the data. Like the semi-structured interviews, they had the flexibility to be able to 
focus on the big ideas, as well as unique understandings, in each unit. 



Quantitative Data 

Though the qualitative data generation and analysis processes provided the majority of 
important understandings, the quantitative data were important, because they provided an 
additional perspective and triangulation for the qualitative data. They also raised unanswered 
questions that will continue to be addressed through both qualitative and quantitative methods, 
particularly about the Attitude Assessment. 



Performance Assessment 

The data suggested that there were significant gains for the Partners in Science 
classrooms compared to the control classrooms. In addition to showing significant gains, the 
Performance Assessment provided considerable support to the qualitative data on how the 
project supported student learning of science process skills. It also supported the qualitative data 
in suggesting that there may be a relationship between the amount and quality of time partner 
scientists spent in their classrooms using process skills with students may have made a difference 
in how deeply students were able to understand and apply science process skills. 



Summary: 



As the project begins its final year, research data (1997-1999) gathered from teachers, students, 
and scientists indicates that the project is being successful in each of the three targeted areas: 
Improving the student’s understanding of science by designing and conducting their own 
research; Effectively utilizing technology as a part of the learning and teaching of science and 
mathematics; Bringing active scientists into the teaching and learning process, both in and out of 
the classroom. Additional information including sample CD’s, and brochures can be obtained 
from the Partners in Science web page r http://www.northstar.kl2.ak.us/nsfpis/vsm.html) . 

Details of the local evaluator’s report can be found in the Partners in Science Quarterly Report to 
NSF (Stayrook 2000) and in Gordon (Gordon 2000). 
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Abstract: Despite the indisputable advantages of using information technologies in teaching 
mathematics in general and linear algebra in particular certain problems related to 
technology-oriented education have become quite evident now. The presentation reviews 
and analyses efficiency and expediency of using information technologies at different stages 
of teaching linear algebra. Our research is based on the results of the experiment conducted 
during the last five years in teaching linear algebra with MATLAB and modem calculators. 
This paper is a follow up of an earlier article “Linear Algebra With MATLAB Package In 
Preservice Teacher Education” (Bouniaev, 1997). 



Introduction. Basics of DMA Theory 

Our analysis of using information technologies in teaching linear algebra is based on the theory of 
stage-by-stage development of mental actions (DMA theory) developed by the Russian school of psychology 
(Galperin 1960, Leontyev 1975, Talizina 1975) as applied by the author in teaching mathematics (Bouniaev 
1991, Bouniaev 1996, Bouniaev &Connell 1996). Without going into a detailed description of this theory we 
will outline some of its basic concepts that are essential for this paper. We also assume that in a linear algebra 
course an instructor can use various technologies at different stages of instruction, such as modem calculators 
and software packages like MATLAB or Derive. So we are not going to specify what software or a calculator 
should be used in the course of instruction . In most cases this problem of choice may be solved by different 
means and depends on their availability. According to the DMA theory the major goal of instruction is 
developing mental actions with objects of the studied field. Finding a solution of a system of linear equations, 
proving that systems of vectors is linear independent (dependent), reducing matrices to the reduced row 
echelon form, finding eigenvalues or eigenvectors are examples of the actions to be developed in a college 
linear algebra course. 

Instruction is viewed as organizing and controlling students' activities and hence organizing and 
controlling the process of development. Thus, instruction efficiency is determined to a great extent by a well 
developed system of control and management. 

Analysis of component operations of any action shows that they perform different functions. A part 
of performing an action is taken up by some preliminary work, a preparation for an action in a certain sense. 
This preparatory part is called orientation part of an action. The performance itself is called executive part 
of an action. Analysis of an action and experiments carried out in this respect show that there also exists a 
control part which takes place after the executive part, when an individual compares the results achieved in 
the executive part of an action with the goals of an action and the draft plan of the execution planned in the 
orientation part. 

As a rule, the performed actions consist of other, more primitive actions and in their turn can be part 
of other actions. Actions that are part of a given whole, are called operations. That is, operations are also 
actions; hence the term emphasizes only a hierarchical subordination among actions. The DMA theory 
specifies four independent characteristics of any action used to determine the level of development of an 
action. The first characteristic is a form of action . An action can be in a materialized (material), speech or 
mental form. The materialized form of action is connected with manual activities (manipulation, hand-on 



activities, etc.); objects of action (or their models) are presented in a material form; results of action should be 
real transformations of these objects or of their models. For example, entering an equation into a graphic 
calculator could be considered as an action in materialized form. 

There is no need to discuss the speech form of an action. It should be noted that according to the 
DMA, writing belongs to the same form, i.e. the speech form. If we consider an example of solving a system 
of linear equation then the speech form will mean articulation of the performed actions. There is no need for 
these objects to be present in the material form. For example, in the process of instruction a student may be 
asked to comment on all the operations of entering an equation into the calculator. The action can be an 
answer in the form of oral speech or a note in a workbook. 

The mental form of action is the highest form of action development. An action in this form is 
imperceptible for one’s associates and its results are recorded in an imperceptible for others form also. This 
form of action means that its objects are representations, notions and concepts. All operations are performed to 
oneself The ability to perform a whole action in the mental form indicates that it has gone through all the 
stages of development and interiorization. 



Structure of the actions to be developed in a linear algebra course 

The primary goal of the first linear algebra course is introduction of basic concepts of the subject such 
as systems of linear equations and their solutions, the concept of a matrix, linear space and linear operator. 
Activities-oriented learning theories claim that development of concepts takes place through development of 
actions aimed at the objects that fall under these concepts as well as at the objects that fall under the concepts 
immediately connected with the developed one. 

All actions can be referred to two categories: general logic actions and specific actions. The 
characteristic general logic action for a linear algebra course is that of recognition. For example recognize if a 
matrix in the reduced row echelon form is an augmented matrix of the inconsistent system of linear equations. 
Another example of a general logic action is an action of classification, for of matrices into subclasses of 
singular and nonsingular matrices. We will demonstrate that developing general actions is crucial in the 
course of linear algebra study. 

Specific actions are basically inherent to a given subject field. For example, in linear algebra they 
are: reducing a matrix to the reduced row echelon form, matrix multiplication, finding determinant of a given 
matrix, etc. We will show that in developing basic concepts of linear algebra most specific actions can be 
performed with the help of technologies. 

Let us consider the structural composition of some actions aimed at developing the basic concepts of 
a linear algebra course. Naturally, if we consider the development of the systems of linear equations concept, 
then the basic action to be developed is that of finding a solution of systems of linear equations. This action is 
not homogeneous, it consists of a sequence of certain operations. 

Example 1 Action of solving a system of linear equations . 

- Operation 1 . Recognizing the system as a linear system (general logic action). 

- Operation 2. Recognizing variables, coefficients, constant terms (general logic action). 

- Operation 3. Rewriting the system in the standard form (specific action). 

- Operation 4. Finding a method of solution (general logic action). 

- Operation 5. Creating a matrix A — augmented matrix of the system (specific action). 

- Operation 6. Reducing matrix A to the reduced row echelon form (specific action). 

- Operation 7. Making a conclusion based on the form of rrefA (general logic action). 

- Operation 8. Determining the method of solution that depends on the results of performing 
operation. 

-Operation 9. Solving the system given in the reduced row echelon form. 

In developing the concept of vector space an important role belongs to developing such actions as 
recognizing linear independent (dependent) system of vectors; determining whether this particular vector is a 
linear combination of vectors of the given system and recognizing the basis of a vector space. Let us consider 
the operational composition of these actions. 




Example2 Action of recognition of linear independent (dependent) system of vectors . 

Assume we have a system of vectors ai=(a n , ..., a lm ),..., a n =(ani, a nm ) in m-dimensial eucledian 
vector space R m The problem is to determine whether this system is linear independent or dependent. 

- Operation 1. Designing a master plan for solution (general logic action). 

- Operation 2. Creating the system of linear equations xiai T +...+ x n a n T = 0 (specific action) 

- Operation 3. Creating the matrix A = [a/ . . .a n T 0] (specific action). 

- Operation 4. Reducing the matrix A to the reduced row echelon form (specific action). 

- Operation 5. Making a conclusion based on the form of rrefA (general logic action). 

Example3 Action of representing a vector as a linear combination of the system of vectors . 

Assume we have a system of vectors ai=(an, ..., ai m ),..., a n =(a nl , ..., a nm ) and the vector b=(bi, 

bj in m-dimensial eucledian vector space R m . The problem is to determine whether the vector b is a linear 
combination of vectors a; , i=l . . .n. 

- Operation 1. Designing a master plan for solution (general logic action). 

- Operation 2. Creating the system of linear equations xia| T +...+ x n a n T = b (specific action) 

- Operation 3. Creating the matrix A = [a/ ...a n T b T ] (specific action). 

- Operation 4. Reducing the matrix A to the reduced row echelon form (specific action). 

- Operation 5. Making a conclusion based on the form of rrefA (general logic action). 

Example 4 Action of basis recognition _. 

Assume we have a system of vectors ai=(an, a lm ),..., a 0 =(a n i, ...» a nm ) in m-dimensional 
eucledian vector space R m . The problem is to determine whether this system is a basis for R m or not. 

- Operation 1. Designing a master plan for solution (general logic action). 

- Operation 2-5 as in example 2. 

Then we have to check whether any vector in R m is a linear combination of vectors aj,.. ., a n . It may 
be done in different ways. Usually we choose the method that assumes the use of technologies, but not 
symbolic computation systems. So the idea is to check whether the vectors of standard basis ei,..., e n are 
linear combinations of vectors ai,..., a n . This problem can be substituted by the problem of determining 
whether n systems of linear equations are consistent or not. Fortunately all these systems have the same 
matrices of coefficients, so it makes sense to determine their consistency simultaneously. 

-Operation 6. Creating the matrix A = [a/ ...a n T ei T ...e n T ] (specific action). 

- Operation 7. Reducing the matrix A to the reduced row echelon form (specific action). 

- Operation 8. Making a conclusion based on the form of rrefA (general logic action). 

From the point of view of our analysis it is instructive to compare the operational composition of the 
action of the previous example with the action of finding a matrix that is inverse to the given one. 

Example 5 Action of finding matrix inverse . 

Assume we have matrix A== [ai T . . .a n T ] . The problem is to find its inverse. 

- Operation 1. Designing a master plan for solution (general logic action). 

- Operation 2. Creating the matrix A = [a/ . . .a n T ej T . . .e n T ] (specific action). 

- Operation 3. Reducing the matrix A to the reduced row echelon form (specific action). 

- Operation 8. Making a conclusion based on the form of rrefA (general logic action). 



Developing Actions In A Linear Algebra Course 

Comparison of the operational composition of actions of the above examples shows that actually the 
only “transformational” operation in all of these actions is that of reduction of the matrix to the reduced row 
echelon form. Analyzing the actions to be developed in a linear algebra course one may come to the 
conclusion that the majority of actions to be mastered by students in this course can be presented as a sequence 
of three absolutely identical operations. The first operation is construction of a certain matrix, second - 
reducing this matrix to the reduced row echelon form, the third is interpretation of results, i.e. comparison of 
the original matrix with the one in the reduced row echelon form. 

It is easy to see that the above problems require practically identical treatment not due to the limited 
number of concepts we operate with in linear algebra but because these operations form only the executive part 



of action. The executive part of action in many linear algebra problems comes down to construction of a 
matrix and its reduction to the reduced row echelon form. 

In real life situation (not in class) that require performing any of the above described actions it would 
be natural to perform explicitly only the executive part of the action. An engineer or a mathematician would 
enter the matrix into the computer or the calculator and then push the button controlling “rref’ command 
irrespective of the fact whether one is looking for the solution of the system of linear equations or proving that 
system of vectors is linearly independent. The situation is completely different in class since all students 
actions are not aimed necessarily at getting the right answer for the given problem but more at acquiring skills 
to solve problems of this category. 

In the course of the experiment while studying the linear independence and the concept of basis in the 
experimental group we allowed the students to start the solution of problems right from the executive part of 
the action. Thus, for example, in developing the action of recognizing the linear independent system 
(example2) students were not required to start with the system of linear equations but with operations 2 -3 ( 
entering the matrix in a computer or a calculator and finding its reduced row echelon form). In the control 
group the students were required to start with the system of linear equations and write down an explanation 
how this system is related to the problem in question. Thus the experimental group in the course of study was 
able to solve almost twice as many problems as the control group but 60% of the students experienced 
considerable difficulties substantiating their actions, and they also provided substantiation that could be 
related to a different class of problems. They could not extend the same idea to a similar class of problems. 

While determining the fact that given vectors generate the entire space (example 4) the students of 
the experimental group were allowed to perform all operations (except 6 and 7) mentally. The students in the 
control group were required to write down all operations with detailed substitution. The day before we 
discussed these topics we found an excuse to remind the students how to find an inverse matrix, i.e. actually 
reviewed the operational composition of the action of example 5. 

Proceeding from the assumption that the executive operations of example 4 (operations 6 and 7) and 
example 5 (operations 2 and 3) are absolutely identical the students from the experimental group came to the 
independent conclusion that actions of examples 4 and 5 are based on the same idea (which is a 
misconception). All the attempts to provoke students in the control group to come to the same conclusion 
failed. The control group students were fully aware of the fact that despite the superficial similarity of the 
execution parts of these actions their orientation parts are absolutely different and thus these actions cannot be 
similar. 

According to the DMA theory, besides the form any action has another three independent 
characteristics: 

- degree of generalization ; 

- degree of completeness; 

- degree of assimilation. 

Generalization of an action means the ability to determine and discriminate essential for performing 
an action properties as well as the ability to apply them to objects of different nature . For example, if the 
action of solving systems of equations is developed at a high enough level of generalization the student does 
not find it difficult to progress from solving the system of three equations with three unknowns to solving any 
system. It also does not matter how the unknowns are designated. The degree of completeness indicates 
whether all the operations that were to be performed in the process of performing an action have been actually 
completed. If the action is already developed, then the subject of the action (the student who performs it) 
practically does not discriminate operations from each other, i.e. the action takes place in the compressed 
form. If we assume that the previous learning was successful, then failure to perform an action (without any 
time limits) often indicates that a student can not present the action in operation-by-operation form when all 
the operations are present and are clearly identifiable. This indicates that performance of the action is not 
completed. The ability of the student to perform an action in the operation-by-operation mode giving 
justification for their performance shows that the action was developed at the sufficient degree of 
completeness. 

Going back to discussing different approaches to organizing the learning process in the experimental 
and control groups we can come to the conclusion that in the experimental group the development of actions 
did not reach the required level of completeness which in its turn affected negatively the degree of 
generalization of the developed action. On the other hand, the degree of assimilation was higher in the 
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experimental group. 

In the experimental group we had to spend additional time to develop the actions at the required level 
of generalization. For this purpose we created a class of exercises that we called inverse problems. The 
students were given only the executive part of the action of the problem to be solved. The task was to restore 
the full operational composition of the action. 

This experiment as well as other experiments conducted in the course of teaching linear algebra with 
information technologies demonstrated that each part of the action should be singled out and developed 
separately. In the process of instruction the executive part of an action should be performed by a computer or a 
calculator. 

The executive part usually is a specific action for the subject. The orientation part as a rule is a 
general logic action aimed at the objects of the studied field. The orientation part of an action includes 
intermediate goals, reducing a problem to the already familiar ones, selection of definitions and theorems 
related to the performed actions.Thus in the above examples the problem is reduced to determining the 
consistency of the sysem of linear equations. The expediency of this problem substitution is determined by the 
corresponding definitions and theorems. 

In developing any new action in the course of linear algebra its orientation part should go through all 
the forms of development starting at least with written speech. For the above discussed examples 2-4 it means 
that at the initial stage of development a plan of action should be written down as well as all necessary 
theorems and definitions on which this plan is based. The system of linear equations should be presented in a 
written form. Only after completing all these actions a student can use a computer or a calculator to perform 
the corresponding operations. Thus major problems in teaching linear algebra arise not in developing specific 
actions of the course but in developing general logic actions aimed at the objects of the studied field. 

The DMA theory presupposes five stages in organization of instruction . At the first stage the 
instructor presents new material. Taking into account a relatively abstract nature of the linear algebra course it 
is expedient in presenting a new material to illustrate it with practical problems and to create computer models 
of these problems. Thus in teaching the theme Least Squares Solutions it is worth starting with the discussion 
of linear regression and demonstration of vivid programs modeling linear regression. In teaching the 
projections it is hard to overestimate the value of visually enhanced programs illustrating the geometry of the 
performed actions. At the second stage the actions are developed in the materialized form. At this stage of 
instruction it is expedient to organize the work with blocks of texts and illustrations and move these blocks to 
different parts of the screen. 

The third stage is development of actions in the external speech form. At this stage it is important for 
students to articulate their thoughts out loud and write down necessary comments. As experience showed at 
this stage traditional pencil and paper are hard to substitute. Group work is also very useful. Computers can 
be used for conducting different experiments requiring discussions with other students. And only the fourth 
and the fifth stages are developing actions in the form of internal speech and mental form. 

In developing every new action the executive part can be delegated to a computer. Thus for example 
in developing an action of reducing matrix to the reduced row echelon form it is expedient to use programs 
like MATLAB m-file “RREF”, providing executions of elementary row operations at students instructions. At 
further stages of instruction it is expedient to delegate this action fully to a computer or calculator. In finding 
eigenvectors and eigenvalues computers can solve the systems of linear equations and characteristic equations. 
At the same time development of the orientation part of this action should go through all the stages and forms. 



Conclusion 

In the course of study of linear algebra it is expedient to carry out the structural analysis of every new action 
to be developed. It is preferable to present the orientation part with all the necessary operations to be 
performed and to develop it going through all the stages starting with the material form of an action. The 
executive part of an operation can be given over to computers or calculators. At further stages the orientation 
part can become an operation of the executive part of an action and be performed by a computer. It is worth 
pointing out that in developing the orientation part of an action the use of computers can be highly efficient in 
creating visual models and a bank of basic concepts, definitions and theorems. 
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Abstract: In this paper, we describe an educational software tool, which allows students to 
take measurements on images and videos. Students become scientists as they measure, 
collect and analyze data from a wide range of imagery. We will describe two major emphases 
of this work. 

First of all, as a corollary to scientific image processing software, this program was 
fundamentally designed as a general, open-ended tool for investigation. Students have the 
opportunity to learn the scientific process first hand. We discuss the relationship of this 
software to scientific tools, the potential for true inquiry-based learning, and the associated 
issues and problems that occurred in bringing this to the classroom. 

Our second emphasis in this work was to create a tool, which could be used for 
curriculum development and interdisciplinary learning. The software exploits the recent 
availability to students and teachers of an extraordinary plethora of scientific images and 
videos. This allows content to correspond closely to a specific curriculum, to pertinent events 
and to student and teacher interest. We detail several ways that curriculum specialists and 
teachers can take advantage of the wealth of imagery that is currently accessible. Lastly, we 
briefly describe the evolution of the software and the feedback we have received from 
students, teachers, and curriculum/technology specialists. 



Introduction 

In this paper, we describe an educational software tool, called Visual Venture, which allows students 
to take measurements on images and videos. This software was developed by IBM in conjunction with several 
public school districts as part of IBM’s Reinventing Education Initiative. We will briefly describe the history 
of this project and discuss its capabilities and objectives. Throughout the project, there have been two primary 
emphases: 

1 . create a general open-ended tool for scientific investigation in the classroom, 

2. create a tool for curriculum development and situated learning. 

To achieve our objectives, we have studied other projects and received feedback from students, teachers, and 
curriculum/technology specialists. In particular, we have brought students into our usability lab and received 
feedback from teachers at our grant sites and from a panel organized by the Center for Children and 
Technology in New York City. We also performed a small field test in our local middle school and 
participated in an internal three day family science event. In the last two sections of this paper, we would like 
to discuss each of the major emphases of this project including the challenges we faced in bringing this 
software and its paradigm into the classroom. 



History 

IBM has been committed to bringing technology to the classroom. Lou Gerstner, IBM’s chief 
executive, has long maintained that while the commercial world is rapidly embracing technology and reaping 
the benefits, changes in the classroom are lagging far behind (Gerstner, 1994). To help stimulate technological 
advances in education, IBM funded a range of projects, initiated by selected school districts, called 
Reinventing Education (Reinventing Education 1999). One of these projects began in Dallas, Texas. The 
Dallas Public School System was interested in building an integrated math science curriculum for grades 4-8 




and proposed to IBM, a joint effort in which IBM would supply technological innovation. IBM’s role was to 
design software to assist teachers in implementing an evolving integrated curriculum based on the latest 
standards and pedagogic reform. With this objective, Visual Venture was created. 

An integrated math science curriculum brings mathematics to real world scientific problems and 
greater depth and understanding to science. For middle school students, such a curriculum usually begins with 
an understanding of the scientific method and progresses to hands-on experiences with data collection and 
analysis. For each subject such as earth science, biological science or physical science, the particular scenarios 
change. A fundamental theme throughout middle school science, and particularly with the application of 
mathematics to science, involves data gathering, including understanding measurements and units, and data 
analyzing and plotting. However, in attempting to implement an integrated math/science curriculum in Dallas, 
several problems arose. 

The first problem was that mathematics was being shortchanged. Many hands-on activities were 
added to keep kids motivated and learning first hand. But the consequence was that the mathematical 
principles were introduced only obliquely and not thoroughly taught. The second problem was that in 
collecting measurements and building tables and plots, students and teachers could easily make mistakes along 
the way. It was difficult to oversee a laboratory experiment and understand the results in the short time allotted 
for a typical class. Lastly, each activity and use of a related software package was different. For each new 
project, students and teachers needed to learn another software program, another piece of equipment, a new 
modeling method. To design an integrated math science curriculum, schools would need to purchase an 
extensive set of software and equipment. There was a need for a few common threads to leverage what was 
learned in previous projects and to elevate the sophistication of the work. 

With these problems in mind, Visual Venture was designed to be a “hands-on,” general purpose, 
open-ended software tool. Curriculum designers in Dallas clearly wanted to let kids do things for themselves, 
to help kids to be involved and to explore first hand. This has been an emphasis in new science and math 
standards across the nation. But, it also needed to include an in-depth exploration of a wide range of 
mathematical concepts. By integrating measurement functionality with tabulating and plotting tools, Visual 
Venture allows students to analyze, predict and model based on measurements they have just taken. A wide 
range of mathematical concepts can be introduced and thoroughly explored. The two primary mathematical 
subjects broadly supported are (1) understanding models and relationships through plots and graphs and (2) 
understanding spatial and geometric measurements. The breadth of mathematics that can be contextually 
taught using Visual Venture is described in more detail in (Wahl 1999). 

The second issue that Visual Venture addressed was the need to assist teachers in providing a 
thoughtful scientific investigation, from beginning to end, in their classrooms with limited time and resources. 
How can we help the teacher with all the realistic problems in running an experiment? How do we limit the 
frustrations along the way, of forgetting to take a measurement, not taking the right measurement, not writing 
it down correctly, forgetting what it was a measurement of? Visual Venture provides students with the ability 
to take measurements, explore relationships and predict models. During the same experiment, students can re- 
take measurements, re-play measurements to see if the correct measurements were taken, easily determine 
which points in a plot refer to which measurements and quickly test out several hypotheses. 

The last issue, which Visual Venture addresses, is to provide a teacher with a software tool that can 
be used over and over again for different investigations. Since Visual Venture is a general scientific tool, it 
does require teachers and students to learn how to use it effectively. Teachers and students learn to use a tool 
which is similar to software used by scientists today. Although it is clear, this can take some time and thought, 
the advantage is that students are learning to use technology as it is done in practice. On the other hand, it can 
be used simply at first and in progressively more challenging instances. Most importantly, it can be used in a 
broad range of scientific applications and it can often come to bear on a question that arises naturally in 
learning science and geometry. 

The first version of Visual Venture was designed with the help of math and science teachers at the 
Dallas Public School System in Dallas, Texas. This version was then refined and improved for use in the 
Atlanta, Georgia and Rochester, Minnesota public schools. This was a second phase of the partnership grants 
from IBM, called Reinventing Education II. In Atlanta, Visual Venture was used to improve the math/science 
curriculum in grades 3-8 and to support teacher professional development activities. In Rochester, Visual 
Venture was added to the curriculum in grades 6-8. In the latter project, the district was already familiar with 
image processing in education, and had worked with the Mayo Clinic and its depository of medical images. 
Visual Venture allowed the district to extend its introduction of image processing. 




Visual Venture 



Visual Venture is a prototype of a software tool that lets students take measurements on videos and 
images. It was designed to be similar to tools used by scientist today, but to be more easily used by middle 
school students. Its functionality focuses on simple scientific investigation rather than on sophisticated image 
enhancement and analysis. It also provides more feedback for learning and ease of use by middle school 
students in a class environment rather than complex manipulations. 

Visual Venture can be used with images and videos from several types of sources. Images from 
textbooks or reference materials can be scanned, images taken by analog cameras can be reproduced digitally, 
or digital cameras can be used. More and more, images can be found on the World Wide Web. Similarly, 
analog videos can be digitized using digitization hardware, digital videos can be captured, or videos can be 
found on the Internet. Projects in Visual Venture can be comprised of a single image, a stack of images or a 
video. 

Visual Venture allows students to measure geometric properties or color-coded information that is 
portrayed in an image or video frame. Students can measure the length, perimeter or area of an object, or any 
distance, angle or position. Images and videos can be initialized so that measurements are scaled 
appropriately. For instance, students can measure the height of a dinosaur in terms of the height of a man, the 
perimeter of a triangle in inches, the area of a glacier in square miles, the interior angle of a hexagonal honey 
comb in degrees, or the dynamic position in local coordinates of the eye of a hurricane as it travels across the 
country. 

Images can be flipped, rotated or magnified in order to make measurement easier. In addition, special 
tools exist to let users take measurements of color-coded maps, of videos involving motion over time, or of 
complex geometric regions. These tools were selected to broaden the applicability of Visual Venture to a wider 
range of imagery that could be used in the classroom. For example, students can measure the urban growth of 
a city shown in a color-coded map, the trajectory of a ball as it falls, or compare the area of each of the 
continents. 

As measurements are taken, students can drag and drop them onto a spreadsheet, perform 
calculations, and create line or scatter plots, pie or bar charts. Measurements in the spreadsheet can be 
automatically redrawn. The student selects the measurement on the spreadsheet and depending on the type of 
measurement, it is shown on the image. For example, if the measurement was the height of a person in the 
image, taken by drawing from the foot to the tip of the head, redrawing will mark this height on the image in 
the same way it was originally measured. Similarly, if a plot is created of the height of three objects in the 
image, the user can click on a point in the plot representing the height of one of the objects. This will 
highlight the corresponding measurement in the table and the height of the associated object in the image. 

Visual Venture has also been designed to link projects to information on the Internet, to allow 
curriculum specialists, teachers or students to create and share new projects, and to let students create reports 
with their results. 



A Scientific Tool for Students 

The majority of software designed for educational purposes can be categorized as one of four types: 
Drill and Practice, Information and Reference, Simulations and Games, or Investigative Tools. Although each 
type can be used to enhance education, the latter category of Investigative Tools has a unique role to play in 
education. A wide range of software and resources already exist and are being used in the first three categories. 
These types of software are usually straightforward to use and apply. They each play a similar role to activities 
that have always taken place in the classroom. However, their use is often limited to specific content or to 
passive perusal. The ability to incorporate investigative tools into the classroom offers a unique opportunity for 
technology to radically improve pedagogy; in the same way, software tools have played a large part in the 
technological revolution at the end of this century. 

Several researchers in education have shown the merits of investigative software. A class of software 
referred to in the literature as microcomputer-based laboratory or MBL has been shown to be an effective aid 
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in teaching science (Nakleh 1994). Researchers have shown that through data logging with computers, a 
student’s ability to perform various types of mathematical abstractions can be improved (Friedler 1997). 
Others have studied the benefits of active inquiry-based learning (Hoffer 1992). The latest changes to the 
National Science Education Standards emphasize “Science as Inquiry.” The standards that teachers need to 
address have changed from “knowing scientific facts and information” to “understanding scientific concepts 
and developing abilities of inquiry” (NSES 1999). 

Spurred by this emphasis in inquiry-based learning, a movement has begun to bring image and video 
processing to education. In 1989, researchers at the University of Arizona in Tuscon began a project called 
Image Processing for Teaching or IPT (Greenberg 1998). Using software designed originally for scientists, this 
project introduced image processing to education through teacher education, the design of curriculum 
materials and strong follow-up support. We believe this undertaking will help bring technology into the 
classroom. Although evidence for inquiry-based learning is strong and pervasive, our experience has shown 
that teachers and parents are often uncomfortable in the implementation. True inquiry-based learning using 
sophisticated technological tools will not widely occur in this country unless it is a required part of pre-service 
education of science teachers. At this juncture, teacher education through workshops, supporting materials, 
and follow-up are needed. 

The software used by the IPT project was originally designed at the National Institute of Health for 
biomedical research. It is a complex tool with an extensive range of functionality designed for scientists. It 
requires some training even for a professional in the field. By using a simpler tool designed specifically for 
students, it is possible to more easily introduce image and video processing to education. Other projects have 
begun which introduce motion analysis through video processing (Gross 1998, Escalada 1996, Learning in 
Motion 1999, Rubin 1996, VideoPoint 1999). These projects/products involve tracking moving objects over 
time in order to study physical phenomena such as gravity or the Coriolis Effect. (Escalada 1996, Gross 1998, 
VideoPoint 1999) are each happening at the undergraduate level and involve teaching physics and motion 
analysis. These product and projects are exciting ways to bring inquiry-based learning into the classroom via 
technological tools. They differ from Visual Venture in being primarily designed for motion studies and for 
older students. 



Bringing the Technological Revolution to Children 

Our second objective in building Visual Venture, was to create a tool for curriculum development 
and contextual learning. We wanted to take advantage of the enormous range of content available through the 
world wide web and to allow students, teachers, and curriculum specialists to design materials pertinent to the 
classroom. 

Below is a list of 20 images or videos and a description of the type of investigation that could be used 
in Visual Venture. This list give the reader an idea of the various types of imagery that can be used and the 
wide range of subject area that can be covered. By using imagery taken by the classroom or found on the 
Internet to enhance areas of current discourse, the software can be used to create contextual learning. 
Contextual learning has been well-documented as an effective means of improving pedagogy (Brown 1989). 
By engaging students in activities that are real, are relevant to their lives, and are meaningfully related to 
events that are occurring around them, they become motivated and more likely to retain what they have 
learned. 

1. Video of Satellite Imagery of a real hurricane - students measure the path of the eye of a hurricane and 
predict where it is going and how far away it is from where they live. 

2. Video of the sky over the course of a night - Students leam how to use the stars to navigate. Why did the 
fleeing slaves on the underground railroad follow the “drinking gourd?” 

3. Series of pictures of the nine planets and some of the moons in the solar system- students compare the 
sizes of the planets. Are some of the moons larger than some of the planets? Also, pictures showing the 
relative distance of the planets from the sun. Are the planet sizes related to their distance from the sun? 

4. Video of night sky at the same time each night over a month, showing the position of a comet relative to 
the other stars - predict where the comet is going with respect to the stars and whether you’ll be able to 
see it in your backyard on a particular night. 

5. Video of the sea surface temperature of the Pacific Ocean - map color-coded with temperature. Students 
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learn about the effects of El Nino on the temperature of the ocean. When are hurricanes most likely to 
occur? 

6. Video of a glacier over the course of a year. Students measure how the glacier grows and melts during one 
year. 

7. Video depicting urban growth around a major city over the last two hundred years. Students measure the 
urban growth, visually see the exponential explosion, and predict future growth and its impact on the 
region. 

8. Color-coded map indicating the different regions of the U,S. based on predicted level of earthquake 
damage. Students are given the role of Secretary of the Interior, and asked how much money should be 
allotted for each region of the U.S. 

9. Map of the world with the continents shown. Students compare the size of the continents by actually 
measuring the area of each continent. Is Antarctica bigger than Australia? How much more water than 
land is there in the world? 

10. Drawings of various dinosaurs and a man, scaled appropriately. Students decide how far each dinosaur 
would stretch if it were put in their school hall, 

1 1. Heart electrocardiograms (EKGs) for different patients. Students act like emergency room physicians and 
decide which patient has the most irregular heart rate. 

12. Real photograph of a nautilus shell with all the chambers shown. Students measure and predict how a 
nautilus shell grows. Will the next chamber be big enough to fit their fist? 

13. Series of pictures of a human as they grow from birth to adulthood. Students measure how people grow. 
How old is a child when his legs become as long as the rest of his body? How does this compare with the 
age that children normally learn to walk? 

14. High-speed videos of a horse running on a treadmill. Students measure how the back leg distance 
compares with the front leg distance over time. When a horse has its front legs together, what are its back 
legs doing? 

15. Aerial photographs of baseball stadiums. Students determine in which stadium it is easier to hit a home 
run. Which stadium is the hardest to defend, i.e., has the largest outfield? 

16. Videos of an Olympic diver as seen from the side with the camera position fixed. Students measure and 
compare how high each diver jumped off the board and at what angle their legs hit the water. 

17. Real photograph of a target board with each score region colored differently. If you are equally likely to 
hit any part of the target, what is the probability that you hit the blue part? Given the scores for each 
region, where is it best to aim? 

18. High-speed video of a kid tossing a ball or dropping it. Students study the motion of a falling object and 
estimate how long it will take to hit the ground if it was dropped from the Empire State Building. 

19. Real photograph taken by a security camera at a downtown grocery store. Suspected criminals and their 
shadows are in the image plane (i.e., to scale). Students become detectives and try to determine if 
someone that sits next to them at school could have been the at the scene of the crime. 

20. Drawings of optical illusions. Students predict and then measure the length of various bars. Then they see 
examples of similar optical illusions used in architecture. 

Conclusions 

While a technological revolution is transforming the way we work and live, it is only beginning to 
impact the way we educate. There is strong evidence to suggest that investigative software can be effective to 
teach students how to solve problems and model scientific phenomena. It has also been shown to improve the 
level of mathematical comprehension and sophistication. At the same time, students learn valuable skills in 
the use of scientific technology. In this paper we have described a new software tool, designed specifically for 
students, which can be used to help realize these goals. This software provides students with the opportunity 
for first hand exploration of a broad range of curricula. Students can visually explore scientific phenomena 
while they measure, tabulate and analyze. 

However, unlike software that can be used to drill or teach new information through text, pictures, 
videos or simulations, investigative software requires additional training for students and teachers. To reap 
the benefits of technology, we need to improve the technological proficiency of our teachers. The first step of 
building tools that support scientific investigation, in the same manner as scientific research tools, is 




underway. To use these tools to exploit their pedagogical potential, we need to train teachers to use them. Our 
experience with teachers has led us to believe they are often uncomfortable without step-by-step guidance. 
Incorporating more guidance into investigative software either through lesson plans or teacher assistance 
appears to be necessary. The creation of a web-based site for sharing lessons and implementation suggestions 
would be useful. Lastly, a body of successful lessons, which could be shared among teachers, is needed to bring 
the use of this type of software to more classrooms. Optimally, lessons should be designed with the assistance 
of scientists in related disciplines in order to incorporate authentic imagery and scientific phenomena. 
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Abstract: This paper reports the results of a two year study investigating the types of experiences 
and support necessary for in-service teachers to effectively integrate Geographic Information 
Systems (GIS) in their teaching/leaming environments. Questions guiding the investigation 
included 1) can GIS be a useful tool in the classroom and 2) will teachers’ participation in an 
extensive in-service affect their level of confidence in their ability to use GIS and/or their attitudes 
toward GIS as an effective tool in the classroom. Assessment measures included (1) contrasting the 
level and type of teacher use based on classroom observations, interviews, participation in web- 
based discussions, and lesson plan analyses; and, (2) teacher self-ratings on a 14-item Likert 
confidence and attitude instrument. The large majority of participants did plan and implement GIS 
lessons in meaningful contexts. Statistically significant gains were detected (p<. 001) for each of 
the fourteen items on the teacher survey. 



Introduction 

The development of national and state standards which call for more relevancy and examples of real world 
applications as well as more emphasis on problem solving skills and inquiry has generated exploration of new 
instructional materials and strategies. Geographic Information Systems (GIS) is a tool that is being used extensively 
by researchers, scientists and planners to inform decision making about real world problems. Application of this 
technology to such concerns as the environment, agriculture, land use management and infrastructure development 
is occurring on local, regional and national levels. Until recently it was not feasible for educators to use this spatial 
data resource because the cost of the software was prohibitive and the size of the data files was too large to load on 
the personal computers used in most school settings. Demand from public and private sectors coupled with spiraling 
innovations in technology have resulted in the recent introduction of software which can be used to manipulate 
spatial data on personal computers. While the functional capabilities and methods of spatial data encoding vary 
among venders, geographic information systems are powerful tools for storing, analyzing, displaying and processing 
spatially referenced information. Software companies such as Environmental Systems Research Institute, Inc. 
(ESRI) have produced software bundles for school systems at affordable educational prices. 

Educators are beginning to investigate productive uses of GIS in teaching/leaming environments. Examples 
are varied and range from 4th - 6th graders updating a database for a state-run recreation area (Robinson 1 997) to a 
cooperative project between high school students in Michigan and Italy to redesign Aviano Air Force Base 
transportation and evacuation systems (Michelsen 1997). Other opportunities for substantive, authentic 
investigations in earth science, geography, life science, physical science and mathematics are clearly available. 
Additionally, partnerships are emerging between schools and institutions of higher education to tackle the challenge 
of identifying and creating accessible data sets and developing exemplary instructional materials (McClurg & Lemer 
1998; Lyon 1997; Rooney 1997; Slater & Fixen 1998). 

Investigations examining the claims that novices can use GIS technologies as problem-solving tools and 
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that these tools can enhance student understanding are informing instructional practices (Audet & Abegg 1996; 
Ramirez 1996). Some schools are instituting curricula that require GIS technologies in at least two different modes: 
GIS education and GIS in education (Palladino & Goodchild 1993; Ramirez 1996). 

While initial users of GIS were often self-taught it is not realistic to assume that teachers, while working 
full time in demanding jobs, will be able to incorporate these new strategies into their professional repertoires. 
Ample evidence exists to suggest that teachers need information, theory, modeling, support, and feedback to learn a 
new teaching strategy (Joyce & Showers 1988). Teacher time is another key issue (Fullan & Miles 1992). Bohlin 
and Hunt (1995) reported an increase in confidence and attitudes and a decrease in computer-anxiety when pre- and 
inservice teachers were enrolled in courses that met over a longer period of time. Not only do teachers need time to 
learn the skills, they need time to experiment, to reflect, to revise and to integrate new understandings (Loucks- 
Horsley, Hewson, Love & Stiles 1998). 

Professional development opportunities, such as extended workshops and institutes, are typically the forum 
for teachers to learn new teaching strategies. Loucks-Horsley, et al. (1998) describe five implementation 
requirements for such experiences to be effective. These include: 1) expert knowledge through a leader or facilitator; 
2) time away from the workplace, with arrangements for substitutes or stipends, to free teachers from their regular 
duties; 3) a curriculum or syllabus to inform the participants about the content; 4) Access to resources and materials, 
i.e. classroom materials, texts, tutorials, and software; and 5) incentives such as stipends or graduate credit. Such 
experiences are necessary for teachers to integrate GIS in their classrooms. 

The EdGIS Conference final report (1995) supports the need for effective professional development in 
using GIS in the classroom. It states, ’’For GIS to have a broader impact on education, progress needs to be made in 
several key areas of implementation: development of exemplary curriculum materials... teacher training, and dealing 
with issues of equity of access” (p. 19). This call for quality teacher training is supported further by a survey of 
educators using GIS in their classrooms. Audet & Paris (1997) found that 77% of respondents strongly agreed that 
teacher training is necessary before introducing GIS in the classroom. In addition, 75% of those surveyed agreed or 
strongly agreed that teaching with GIS requires new teaching methods. 

The purpose of this study was to develop effective professional development experiences for teachers to 
learn how to use GIS resources in their classrooms to increase and enhance student achievement in areas of 
geography, science, mathematics, technology and art. To accomplish this goal, workshops were conducted, assessed 
and revised in an iterative process. 



Description of the Research 

The efforts to provide Wyoming teachers with content background and skills to use GIS in the classroom 
began in 1995 through the development of the Earth System Science Internet Project (ESSIP). The primary goal of 
this project was to form a collaborative partnership between scientists and science educators at the University of 
Wyoming and K-12 teachers throughout Wyoming. The project focused on creating eight authentic learning 
experiences through the use of remotely sensed data, GIS, spatial data accessible over the Internet, and collaborative 
lessons requiring participation through the Internet across multiple sites. 

In 1996, fifteen 6th- 12th grade geography and science teachers from five school districts participated in a 
week-long workshop at the University of Wyoming to learn the basics of ArcView GIS (ESRI, Inc.) and test the GIS 
module lessons. As part of the module development process, the teachers were asked to test each of the lessons in 
their classes and provide feedback to the project directors during the 1996-97 academic year. To assist the teachers 
in this process, continual support from GIS technology specialists on the ESSIP staff was provided in the form of 
personal visits, e-mail, and telephone conversations. 

Classroom observations and teacher interviews provided the bulk of the data from the first iteration. Each 
of the teachers was visited during the school year and interviewed about the strengths and weaknesses of the lessons, 
obstacles to implementation, and suggestions for improving various aspects of the project. The teachers were then 
brought back together in the summer of 1997 to discuss these same issues. 

A second iteration of the workshop was conducted over the 1997-98 academic year. Several changes were 
made to the content and format of the workshop based on the feedback from the first workshop participants. As with 
the first iteration, two part-time personnel were available to assist teachers during the transfer of these activities to 
the classroom. They were available by phone, e-mail and personal visits to the school sites to assist teachers with 
any hardware or software problems they might encounter and to model teaching in participants' classrooms. 

Assessment measures included classroom observations, interviews, teachers' ability to demonstrate their 
skill to workshop leaders and cohorts, and analysis of: 1) a web-based discussion; 2) lesson plans; and 3) student 
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projects generated in teachers' classrooms. Teachers were also asked to rate themselves on a 14-item Likert type 
scale at the beginning and the end of the workshop. Twelve of the items dealt with participants' level of confidence 
regarding their ability to use and or to implement GIS in the classroom. Two of the items were statements related to 
participants' attitude toward GIS as a tool in the teaching/leaming environments. This instrument was designed by 
the authors and distributed to a five-member panel for review. Modifications were made and the questionnaire was 
redistributed to the panel and approved prior to use as an assessment tool for the in-service activities. 



Results 

Observations from classrooms during the first iteration provided information about the introduction of GIS 
to 6th- 12th students which was then transferred to introducing the software to teachers participating in the second 
iteration. Students were observed using GIS as an exploratory tool, so the second iteration was planned to provide 
more opportunities to explore data. In addition, student groups of two appeared to work best where resources were 
limited, but a 1:1 student-to-computer ratio was ideal, so greater emphasis was placed on each participant having 
access to a computer in the second iteration. 

Along with observing the students, the teachers were tracked and interviewed regarding their use of the 
modules and general participation in the project. Five teachers expressed hardware obstacles as the primary reason 
for not fully participating. Seven others described unrelated commitments as the main obstacle in participation. Only 
three teachers felt satisfied in their implementation of the GIS lessons. Each of the 15 teachers had volunteered and 
made a commitment to participate, but a stronger incentive was needed to encourage full participation. As a result, 
the second iteration was offered for graduate credit from the University of Wyoming. 

Direct feedback from the participants after the first iteration proved most helpful in redesigning the second 
workshop format. The participants' suggestions which were directly implemented in the second iteration included: 1) 
creating a non-computer-based introduction to GIS concepts such as using transparencies to demonstrate overlaying 
themes and querying; 2) allowing students to create their own data layers to increase motivation and emphasize the 
local focus of GIS; 3) spending more time discussing databases, queries, and the syntax of querying; 4) addressing 
the need for complying with state and national standards; 5) learning how to customize the lesson plans; 6) 
involving more teachers from other districts; and 7) integrating other content areas. The participants also provided 
feedback about difficulties in accessing computers with sufficient memory or other hardware requirements, 
gamering support from administrators and colleagues, and simply remembering how to use the software due to the 
lag-time between the workshop held during the summer of 1996 and implementation of the lessons several months 
later during the 1996-97 academic year. 

This feedback was used to make several modifications for the second workshop. First, the format of the 
workshops was modified from an intense week-long workshop to a seven day, three-part workshop extended over a 
six month period. This was to give the participants opportunities to test and refine their skills at home and in the 
classroom between sessions. The intermediate session would then provide reinforcement, remediation, and 
continued development in the midst of implementation efforts. 

Second, teachers were sought from the areas of geography, mathematics, science and art to provide a 
greater emphasis on interdisciplinary connections of using GIS. The resulting content composition of the teachers 
(5 th - 12 th grade) in the second workshop consisted of science (7), geography (4), elementary (4), math (3), art (2), and 
history (1). Third, the content of the workshop was expanded. The first part of each workshop session was devoted 
to sharing experiences teachers had had using the software and to discussing solutions to any problems that had 
arisen. Remote sensing concepts and the use of Global Positioning System (GPS) were also added. Teaching 
students to use GPS would allow them to generate their own data sets. Teachers also viewed video examples of 6th - 
12th grade students using GIS software in school contexts and participated in interdisciplinary activities which 
incorporated GIS as a tool. Fourth, teachers were asked to bring their own computers to the workshop sessions and 
learned to install the ArcView software and data sets on their own machines. This allowed teachers to gain a greater 
understanding of the installation process and file structure of the software. Fifth, all the participants were expected to 
complete homework assignments during the periods between workshop sessions. These assignments included 
identifying state and district curriculum outcomes and standards that could be addressed by using GIS/GPS, 
developing, teaching and evaluating lesson plans for their students, and posting their ideas, assignments and 
comments on the ESSIP web-based discussion site. 

Thirty-six teachers initially registered for the second workshop, but only twenty-one completed the 
extended seven-day series, nineteen of which took the course for credit. Each of these nineteen teachers identified 
relevant district and state outcomes and standards as well as posted ideas on the discussion site. Twenty teachers 



developed lesson plans, with fourteen being able to implement and evaluate them. Three of the teachers who were 
unable to implement their plans cited lack of access to capable hardware and three stated that they did not have 
sufficient time to test their plans. 

A follow-up workshop was conducted in February 1999 for the participants in the second iteration. 
Thirteen teachers stated at that time that they were able to continue implementing GIS and GPS after the completion 
of the course. Two others were still set back by hardware and time obstacles but stated their intention to forge ahead 
in their efforts. The remaining six had discontinued using GIS in their classrooms. 

Along with teacher participation and workshop development, this study also examined the level and type of 
use by the teachers who participated. As might be expected by the spread of grade levels and content areas, the 
complexity of the lesson plans varied. Generally, the elementary and middle school teachers as well as the art 
teachers used GIS to conduct simple visual investigations without resorting to the Boolean or other intensive 
querying capabilities of the software. For instance, a sixth grade teacher designed a lesson using GIS to introduce 
her students to the five themes of geography by looking at such things as the characteristics and features of a place. 
An art teacher asked her students to use GIS to investigate land forms and land marks then create their own land 
mark stamps. The students then used these stamps along with principles of design and printmaking skills to create 
new maps of the areas under investigation. 

The junior high and high school science, geography and mathematics teachers tended to use more of the 
software's functionality. For instance, a junior high earth science teacher designed a plan in which the students 
would investigate seismic activity in Yellowstone National Park by posing such questions and scenarios as: 

"Does the number and location of seismic events remain relatively constant each year in the park? ... - Do 
significant seismic events occur near areas of sustained human use, so that some assessment of the likely 
risk of a seismic event occurring can be conducted? The quake events would have to be examined in 
relationship to the physical environment of the park (mountains, valleys, rivers, geysers) as well as the 
human features there (roads, campgrounds, visitor stations, etc.)." 

When given the opportunity, the participants of the second workshop were able to develop useful, 
appropriate lessons involving GIS. Comments from these participants indicated that they were excited about using 
GIS to teach content they were already responsible for teaching and saw greater potential for integrating this 
technology into their teaching practice. 

Nineteen teacher participants in the second workshop iteration completed both the beginning and ending 
survey. Table 1 summarizes the beginning and ending means for the pre-workshop/post- workshop rankings on each 





Female Means 


Male Means 


Overall Means 


SD 


t 




Begin 


End 


Gain 


Begin 


End 


Gain 


Begin 


End 


Gain 






Ability to Use GIS 


1.1 


4.9 


3.8 


2.2 


6.7 


4.5 


1.7 


5.8 


4.1 


1.84 


9.46* 


Ability to Use GPS 


1.7 


6.6 


4.9 


6.4 


8.7 


2.3 


3.9 


7.6 


3.7 


2.91 


5.52* 


Create GIS Layer from GPS 
Points 


1.1 


5.3 


4.2 


2.6 


7.8 


5.2 


1.8 


6.5 


4.7 


2.89 


7.07* 


Display & Overlay Themes 


1.1 


6.8 


5.7 


3.1 


8 


4.9 


2.1 


7.4 


5.3 


2.83 


8.19* 


Query Themes 


1.1 


5.3 


4.2 


2.8 


7.7 


4.9 


1.9 


6.4 


4.5 


2.39 


8.26* 


Query Multiple Themes 


1.2 


5.4 


4.2 


2.4 


7 


4.6 


1.8 


6.2 


4.4 


2.01 


9.49* 


Define & Conduct Original Query 


1.1 


4.9 


3.8 


3.2 


7.1 


3.9 


2.1 


5.9 


3.8 


2.34 


7.16* 


Use GIS as a Tool in Classroom 


1.2 


6.1 


4.9 


1.8 


6.3 


4.5 


1.5 


6.2 


4.7 


2.23 


9.25* 


Geo-reference Images 


1 


3.5 


2.5 


1.6 


6.1 


4.5 


1.3 


4.7 


3.4 


2.32 


6.53* 


Layouts 


1.1 


5.6 


4.5 


2 


8 


6 


1.5 


6.7 


5.2 


2.42 


9.40* 


Charts 


1.4 


5.9 


4.5 


1.6 


8 


6.4 


1.5 


6.9 


5.4 


2.27 


10.42* 


Interdisciplinary Connections 


3.3 


7.7 


4.4 


4.7 


8.6 


3.9 


3.9 


8.1 


4.2 


2.75 


6.58* 


Useful: Classroom Tool 


1.1 


7.7 


6.6 


3.8 


9.3 


5.5 


2.4 


8.5 


6.1 


3.30 


6.63* 


Useful: Discussion Web 


1.7 


7.8 


6.1 


2.4 


6.8 


4.4 


2 


7.4 


5.4 


2.66 


6.70* 




*p<0.001 



Table 1: Mean scores and summary of t-tests on the level of confidence and attitude survey (n-19). 

of the fourteen items in the survey. Examination of these descriptive statistics revealed participants' confidence in 
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their ability to use GIS and their attitude toward GIS as a useful tool in the classroom increased substantially. The 
mean self-ratings of their ability to use features of GIS at the end of the six month in-service were quite high with a 
range of 4.7 to 7.6 and a median of 6.4 on a ten point rating scale. Interestingly, females consistently ranked their 
beginning and ending abilities lower than males. Statistically significant gains were detected (p<.001) for the items 
measuring participants' level of confidence in their ability to use GIS. Statistically significant gains were detected 
(p<001) for both items assessing participants' attitudes toward GIS as a useful tool in the classroom. 



Discussion 

Designing effective professional development is a complex task. The purpose of the learning opportunity, 
the content, and the needs of the participants must be matched with an appropriate strategy or combination of 
strategies for promoting learning and change. Then the professional development must be implemented in such a 
way as to provide expertise, support learning, and encourage participation through incentives (Loucks-Horsley, et al. 
1998). 

When introducing new technologies, additional factors must be considered, such as providing technical and 
moral support as well as a sufficient time period to enable the learners to become comfortable with the technology. 
The learners must also see the possibilities for applying and integrating the new technology into existing curricular 
structures. As Audet & Paris (1997) stated, there is a distinction between "knowing how to operate a GIS and 
knowing how and when to apply GIS to solve problems" (p. 300). Appropriate professional development would 
allow teachers to learn how to manipulate GIS and how to apply it meaningfully in the classroom setting. 

Both iterations of the workshop in this study shared characteristics and elements such as workshop 
instructional methods and hands-on activities, technical and moral support structures, and follow-up sessions. Some 
of the teachers in both workshops experienced technical obstacles, lack of administrative support, and lack of 
sufficient time to fully implement lesson plans involving GIS. 

The second iteration of the GIS workshop, however, draws closer to meeting the effective professional 
development models described by Loucks-Horsley, et al. (1998) than the first iteration. It appears to have been more 
effective in promoting lasting change in teaching practice in terms of ability to use GIS and implement it into the 
classroom. The extended time frame of the workshops, stronger incentives, interdisciplinary connections, outside 
assignments to design and test lessons, and on-going communication using the web-based discussion site were all 
significant changes from the first iteration. One or a combination of these changes may be the primary factor(s) for 
increasing the effectiveness of the second workshop. Further interviews of the participants need to be conducted to 
identify specific aspects of the workshop that led to changes in their practice. 

While teachers' confidence in their ability to use GIS grew significantly, there was variability in their 
confidence to use different GIS features. They were most confident in their ability to display and overlay themes, 
conduct queries on existing themes, produce layouts and charts communicating results of their investigations, and 
produce new layers based on data collected during field experiences. They indicated less confidence in their ability 
to geo-reference images and to define and conduct original queries. Geo-referencing images is very important for 
users who wish to superimpose existing remotely sensed images. Defining and conducting original queries is an 
important skill as users work on problems situated in the real world. Continued refinement of the in-service 
experiences in these important areas is clearly indicated. While not a part of the original intent of the survey, the 
obvious difference in confidence level of males and females is perplexing. From the perspective of the workshop 
leaders there was no difference between genders in their ability to use and apply these technological tools. 

Teachers' ending attitudes toward using GIS as a tool to support learning were extremely positive (8.5 on a 
10 point scale). Will these positive attitudes and high level of confidence result in teachers using these tools in their 
classrooms? What kinds of learning experiences are being supported through the use of these tools? Have teachers 
changed their instructional style as a result of using these tools, and if so, how? Are they participating in the 
discussion/support web site? Do they need other kinds of continuing support? What kinds? Is it important to address 
the difference in confidence in ability to use GIS/GPS detected between men and women? These questions and 
others will continue to be addressed by ongoing work. 
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Abstract: A number of factors pertaining to a wide variety of distinctions — such as particular- 
general, arithmetic-geometry, sense-reference, procedural-declarative, concrete-abstract, object- 
attribute — are implicated in developing a meaningful understanding of visual and symbolic aspects 
of mathematics. A rather simplistic "association-abstraction" model of mathematical cognition, as 
it stands, appears inadequate to account for these factors, particularly with respect to instructional 
design and assessment. Such fundamental inadequacies warrant better theory and more research. 
Methodology directed toward this end, drawing on digital video technology, is sketched out. 



Background 

Some of the most vexing problems in the history of philosophy and psychology concern understanding the 
relations and interactions between visual and symbolic aspects of human experience. These problems have proved to 
be particularly acute and germane in the philosophy and psychology of mathematics. Moreover, theoretical 
understandings of the relations and interactions between various visual and symbolic representations, processes, and 
meanings in mathematics and mathematical cognition per se constitute, as their more practical counterpoint, a 
fundamental problematic of mathematics education. 



To get an initial sense of this problem, consider (Fig. 1) the familiar and fairly well-known Pythagorean 
visual images of triangular numbers along with the modem symbolic formula: f(n) = (n 2 + n)/2. 

f(0) = (0 2 + 0)/2 = 0 

• f(l) = (l 2 + l)/2= 1 

• • f(2) = (2 2 + 2)12 = 3 

• • • f(3) = (3 2 + 3)/2 = 6 

• • • • f(4) = (4 2 + 4)/2 = 10 



Figure 1: Pythagorean Triangular Numbers 

These representations and the relations between them require some explication. It may at first appear as 
though there is only one triangular number represented in Figure 1, i.e., 10. It can, however, be readily seen that the 
triangular numbers 1, 3, and 6, are embedded, i.e., in a layered fashion, within it. The visual representation also, at 
least implicitly, suggests that the next triangular number, the 5th triangular number, can be generated by simply 
adding another layer of 5 appropriately spaced units to the previous triangular number in the series. In order to be 
convinced of this, it is helpful to notice the way in which triangular numbers are "defined" or constrained by this 
peculiar triangular form. Triangular numbers, as with other kinds of Pythagorean figures, such as square numbers, 
i.e., f(n)=n 2 , and oblong numbers, i.e., f(n)=n(n+l), are what Mason and Pimm (1984) refer to as "generic examples" 
— in that they provide a sense of being able to see the general case in a particular instance. 

Visual representations such as these can be very helpful in understanding fairly sophisticated relationships 
in the theory of numbers. For instance, by inspection, one can readily convince oneself that the sum of any two 
consecutive triangular numbers is a square number, or conversely, that a square number decomposes into two 
consecutive triangular numbers. Symbolically, on the other hand, for most of us at least, it is not immediately 
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evident that (n 2 + n)/2 + ((n+1) 2 + n+l)/2 = (n+1) 2 . Even with the use of a few mental short-cuts, I used three 
intermediate steps of algebraic manipulation to formally derive this equality — a derivation that would constitute 
only a part of a full-blown rigorous proof of this relationship by mathematical induction. 



Guiding Questions and Assumptions 

There are many questions that can be asked regarding these two qualitatively different kinds of 
representations and the various processes associated with them, but there are two questions of specific interest here: 
1) What factors are implicated in developing meaningful understandings of visual and symbolic representations of 
mathematics? 2) In what ways can computer technology assist learners in developing meaningful understandings 
visual and symbolic representations of mathematics? Whether the first question is explicitly considered or not, 
various answers are implicitly assumed in any instructional design, development, implementation, and assessment of 
educational technology in mathematics education. The main objective of this paper is to consider the first question 
with regard to the second. The purpose is to begin to sketch out a more viable, richly-textured, and theoretically- 
grounded basis for research into the instructional design of educational technology in mathematics education, with 
an eye toward ways in which that technology can be implemented and assessed in the teaching and learning of 
mathematics. 

It is taken as given in this paper that meaningful understandings of mathematics do not exist in visual 
drawings or symbol systems alone, in and of themselves. Rather, they acquire meaning through the minds of 
individuals. That is to say, individual learners are assumed to be actively engaged in constructing mathematical 
understanding, and knowledge cannot be considered, in any absolute sense, to exist independently of them. The 
most challenging aspect of such a view concerns identifying specific details regarding manners in which learners' 
understandings are, or can be, constructed, and how to promote and objectively assess such constructions. This 
general problematic warrants further research into the potential role of educational technology in the visual and 
symbolic construction of meaning of basic mathematical procedures, concepts and relations in mathematics 
education. Some consideration is given to how research into understanding these kinds of constructions may be 
expedited using digital video techniques. 



Troublesome Distinctions 

There are many troubling distinctions involved in understanding visual and symbolic aspects of 
mathematics and mathematical cognition. To begin with, do the same guiding questions of this study, as noted 
above, apply in the same way for different mathematical subject areas? Despite the primary emphasis given herein 
to arithmetic, it is important to ask whether the relation between visual and symbolic aspects for this subject is the 
same as it is, let us say, for geometry. From a formalist perspective, there are essential similarities throughout the 
field of mathematics with respect to axiomatization. Thus, differences in symbolic meaning with respect to formal 
systematic axiomatizations of geometry and arithmetic do not seem as pronounced as the differences in visual 
meaning between them. The visual meanings of geometrical, as opposed to arithmetical, notions have traditionally 
been considered to be much more intuitive for the former than for the latter. Consider the differences, for instance, 
between visualizing a geometrical object such as a triangle versus visualizing an arithmetical object such as a 
rational number. Indeed, it may be impossible to visualize a rational number at all without some form of geometrical 
construct involving spatial extension. All considered, the relation between visual and symbolic meaning is clearly 
more intuitively evident for geometry than is the case for arithmetic. That is to say, the relation between visual and 
symbolic meaning seems to be more problematic with regard to arithmetic than it is for geometry. 

Other considerations have to do with well-known logical and computational distinctions between sense and 
reference and between declarative and procedural propositions. The reference of a mathematical proposition is often 
taken to pertain to the truth or falsity of that proposition. The truth or falsity of *7 + 5 = 12," for instance, depends 
on whether or not a procedure exists that can establish whether or not the sum of 7 and 5 is indeed equal to 12. 
Another way of thinking about reference has to do with the conceptual entities involved in the proposition. That is, 
in this case, whether or not ’7+5" and "12" actually refer to the same thing. Such propositions can be considered in a 
procedural sense, as an operation involving numbers, or in a declarative sense, as an relation between numbers. 



However, these differences are further complicated by whether or not numbers are considered in the concrete sense 
of real physical objects, or in the abstract sense of idealized conceptual objects. 

Moreover, semantic confusions can result with respect to shifting meanings of the object- attribute 
distinction with concomitant shifts in meaning between visual and symbolic representations of numbers. Consider, 
for instance, a shift in meaning in the notion of quantity from that of an attribute of collections of concrete objects 
(as often portrayed to learners with manipulatives, in textbooks, and educational software) to that of a formal, 
abstract, symbolically-mediated object with no concrete attributes whatsoever. Similar difficulties appear to be 
implicated with shifts in meaning of the arithmetic unit as a unit of discrete quantities to one of a continuous unit of 
measure. Such subtle and problematic qualitative shifts in meaning are implicit within the visual and symbolic 
representations of number. These are shifts in meaning that many students never make or begin to appreciate -- even 
if they do happen to gain procedural proficiency with manipulating symbols in accordance with set rules. 

The orientation for instructional design in mathematics education with respect to the relation between the 
symbols themselves is mostly procedural, and matters of reference suitable for assessment tend to focus solely on 
the truth of the proposition — that is, on whether or not learners "get it right," Unfortunately, learners who actually 
do get it right in accord with these criteria may not have much of a clue, at least with respect to the nature of the 
mathematical entities involved and the relations between them, as to what it is they are actually "getting." 



Association-Abstraction Model of Instructional Design and Assessment 

That such troublesome distinctions are germane to instructional design and assessment is evidenced by a 
plethora of educational software designed for teaching and learning mathematics. The two main criteria for 
instructional design seem to rely upon simple, if not overly-simplistic, associative relations between visual (qua, 
concrete) and symbolic (qua, abstract) representations. Visual figures, such as apples, rulers, and pizzas, etc., are 
associated with, or replaced by, mathematical symbols with little understanding, either on the part of researchers, 
designers, teachers, or learners, as to how this is done — let alone what the relation between these kinds of 
representation may be. Such approaches tend to ignore, dismiss, or trivialize fundamental issues concerning the 
relation between visual and symbolic aspects of mathematics while placing the onus on learners to make of it what 
they will, to either "get it" or not. Whether one adheres to a constructivist model of learning or a transmission model 
of learning, how it is that learners actually "get it" is usually based on some rather vaguely defined or poorly 
understood notion of abstraction. 

The main strength, prima facie , of the association-abstractionist model is that it is easy to understand. With 
respect to number, for instance, collections of concrete objects are simply associated with symbolic expressions and 
presumably, after a suitable amount of exposure, some learners, some how, eventually develop a more abstract 
conceptual understanding thereof. The problem with this view is that it sheds little light on any of these other related 
factors involved in learning, and thus offers little guidance for instructional design and assessment. Moreover, this 
view is inherently contradictory if the goal is to gain a concept of number composed of abstract units free of all 
concrete attributes — for if there is no ground to distinguish one unit from another, then there is no ground for there 
to be more than one. The closer one looks at this model, the more problematic it seems to become. 

If existing instructional design and assessment criteria based on the association-abstraction model are too 
simplistic for the effective implementation of educational technology in mathematics education, and there are 
grounds to suspect that they are, then more appropriate criteria are warranted. As it stands, some consideration has 
been given to ways in which visual and symbolic meaning connects with other important distinctions in philosophy 
(particular and general), mathematics (geometry and. arithmetic), logic (sense and reference), computational theory 
(procedural and declarative), psychology (concrete and abstract), and linguistics (object and attribute). It is evident 
these factors are deeply implicated (and should be accounted for) in any model concerned with understanding the 
relation between visual and symbolic aspects of mathematics and mathematical cognition. As it stands, the 
association-abstraction model does not seem to be up to this task. Something else is required. 



Computer Assisted Synthesis of Symbolic and Visual Meaning 
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There has also been much interest over the years regarding visualization in mathematics education (e.g., 
Bishop, 1989; Clements, 1981; diSessa, 1997). This interest has been spurred on by the tremendous potential of 
computers for visualizing mathematics. An over-emphasis of the visual, however, also carries a risk of neglecting 
the more deductive, idealized, and symbolic aspects of mathematics. Such concerns, which by the very nature of the 
subject are of most acute concern in mathematics education, have recently been recognized within science education 
as well (Niaz, 1999; Rocchi, 1998). One of the main short-comings of the association- abstraction model noted 
above is that it provides little insight into what learners actually experience and what they actually do when exposed 
to visual and symbolic aspects of mathematics. New theories and methods are called for. 

That is not to imply that good theory and research is not being done in this area. The analysis provided 
above only scrapes the surface. There is a significant amount of work being done in this regard that should also be of 
interest to those involved in the instructional design and assessment of educational software in mathematics 
education. So much so that it would be impossible to provide any more than a brief sampling of that work here. A 
wide spectrum of recent theoretical perspectives and empirical research regarding analogical and metaphorical 
reasoning is available (English, 1997). Many other important initiatives have recently been taken regarding the 
potential role of computers in promoting meaningful understandings visual and symbolic aspects of mathematics 
(see, for example, Noss & Hoyles, 1996; Sutherland & Mason, 1995). Nevertheless, there is much more work that 
remains to be done toward providing a theoretical framework that is comprehensive and detailed enough to do 
justice to the intrinsic complexities of synthesizing visual and symbolic aspects of mathematical cognition. 

Along with the need of new theoretical frameworks for empirical research beyond the bare-bones 
"association-abstraction" model, there is a also pressing need for more refined and effective methodologies. I 
conclude with a brief description of my own methodological approach for conducting empirical research in this area, 
one which draws upon and integrates the work of many others, specifically designed to take advantage of emerging 
digital video technology for data acquisition and analysis. 

Experimental groups in a computer-equipped classroom, consisting of prospective teachers of mathematics, 
are exposed to educational software specifically designed and developed for exploring relations between visual and 
symbolic aspects of arithmetic and elementary number theory (Campbell, & Fonthal, forthcoming; Greeno, 1991). 
All experimental interventions are recorded on digital video tape for subsequent analysis. Data is acquired at two 
levels of granularity (Rouet, Steffens, & van Oostendorp, 1999). At the macro-level, activities of the class as a 
whole is recorded. At the micro-level, selected individuals' and their screens are separately and simultaneously 
recorded. Data are collected and analyzed using a procedure that allows for the recording and synchronized digital 
playback of all data streams. 

Participants observed and recorded at the micro-level are instructed in the use of a reflection protocol 
involving "thinking aloud" (van Oostendorp & de Mull, 1999), and an attention protocol to "keep their mouse where 
their mind is." Data are analyzed, coded, and indexed using digital video processing software. In particular, a 
variety of action sequences (Goldman, Zech, Biswas, & Noser, 1999) and meta-cognitive factors (Ertmer & Newby, 
1996; Wolters & Pintrich, 1998) are used to help classify the qualitative data. Limitations of the experimental 
software is analyzed in accord with (Chen, 1995; Hannafin & Land, 1997; Lawless & Brown, 1997; van Oostendorp 
& de Mull, 1999) to help identify potential systemic constraints imposed on participants' interactions with it. Finally, 
the data are interpreted, both to determine ways in which visual and symbolic aspects of mathematical cognition are 
interconnected, and for ways in which the experimental software can be improved. 
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Abstract: Today, interactivity is seen as a key factor for achieving effective learning 
environments. Research says that “Interactivity” is a messy idea that takes its meaning 
from a system of metaphysical oppositions. These oppositions range from learner control 
issue to the debate. A group of academicians and researchers were asked to imagine a 
“Richly Interactive Learning Environment” to the fullest degree possible. The 
commonalities and differences in their ideas are investigated in order to come up with a 
shared understanding of interactivity for the new millennium. The aim of this article, is to 
both deconstruct and reconstruct a theory for interactivity with some real ground from 
previous research, ideas from that group, and from the ideas of the authors, as a whole. 
With this framework in hand, we hope that it will be possible to differentiate the real 
promises of “interactivity” from the wonderland promises. 



Introduction 

Recently, there is a term that takes a lot of attention in the educational world. Each day another 
research study is emerging with some ideas on how to make something-either a classroom , a software, a 
textbook, or any instructional design more “interactive” than it was. These research studies do not share a 
common ground to attribute the characteristics that interactivity has or should have. 

Rose (1999) realized the miscommunication, confusion, and false expectations tied to the word 
“interactivity” in educational computing. She used a strategy named after Jacques Derrida “deconstruction” 
to interrogate the system of metaphysical oppositions. She finally claimed that "interactivity" seems to be a 
messy idea that gains its meaning from many opposite meaning terminology. Although her starting point 
was educational computing, the ideas that she come up with are not restricted to only educational 
computing but to whole educational instruction and learning, too. 

Rose (1999) points to the importance and necessity of deconstruction through the purpose of 
breaking down the received assumptions, which are hidden in oppositional terms, is to allow for new 
perspectives and new avenues of thought. In this regard, we may start with a deconstruction from the area 
of language of the term "interactivity". The dictionary of Webster defines "interact" as to act mutually to 
perform reciprocal acts. Although the term deconstructs into two parts as "inter" and "act", the literature 
seems to give meaning to it as it would be given to the word "intra" + "act", too. We will discuss this more 
fully later in this paper. 

In this article, and derived from our research, we try to discuss the situation as reconstructing the 
meaning of interactivity but this time in education general. To be specific, most examples and ideas will 
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reflect science and mathematics education context, since our expertise and interest is in this area, and also 
since it is the area that the most of the information needed is lacking about interactivity. We are not 
restricting ourselves to only educational computing or educational technology to get the breadth and depth 
of the characteristics attached to the term interactivity. With this in hand we aim to come up with a shared 
theory of ’’interactivity" for the new millennium. 

Interactivity in Examples 

The literature seems to have many different interpretations of the term "interactivity". Although, 
these definitions and contexts seem to bind the usage of the term, we believe that starting from those 
examples and the contexts that is mostly used or referred, would be really invaluable. 

The most recent wonderland of the educational world; Internet seems to be in the center of the 
discussion to decide whether or not it is interactive. The idea of its having unbounded information source, 
and the idea of its being static with respect to the information load but not dynamic, seems to be the 
existing dichotomies. The learner can reach a whole catalog of sources but cannot change the structure of 
these sources. In this sense, can we say that it is interactive? The idea of the Web being interactive also 
comes with the possibilities of the new technologies that Internet brings like IRC (Internet Relay Chat), or 
MUD’s (Multiple user dungeons, etc) they provide users the ability to communicate with the other people 
lively, and on time. 

Dockterman (1995) was trying to get the meaning of the term through pragmatics. If its meaning is 
only what is stated in Webster, then can we say it is like "dressing a child"? Or solar system? What about 
remote-controlled TV? But then he also mentioned that there should be some kind of intense conversation 
and debate! 

Regarding the context of learning. Rose mentioned that we need to give up our old notion of 
Socratic Dialogue and search for new situations where we can make the learner play with the path that is 
given to him/her or change for his/her learning interests. Computers or teachers who practice “Socratic 
Dialogue” ask questions designed to lead the learner step by step towards the path that is already planned, 
and hence the learner is no longer on his/her own but tries to accomplish the path prepared for him/her. 
Then the question becomes should we go on with the early Socrates’ ideas about interactivity or should we 
come up with some more recent and more effective ones for this century (Filipczak, 1996; cited in Rose, 
1999). Especially in a century in which technology seems to make any kind of dream possible, we need to 
find some new and critical answers to these questions. 

Although the use of the term is not limited to technology only, technology seems to help it from 
many sides. Recently, the main debate is about the software programs for learning and their interactive 
value. Some argue that it is related with the numbers of keys that is included in the software (Poncelet, & 
Proctor, 1993, cited in Stemler, 1997) and some argue that the much more important thing should be to 
make students think and be provoked (Dockterman, 1995). He was stating that it is not how many buttons 
students can push, but whether one can use the technology to spark thoughtfulness and interaction. He was 
arguing that it should generate a conversation within each student's head. Another main debate about 
educational computing and interactivity is the idea of high interactivity needs highly advanced 
technological tools. This idea needs careful consideration, through the critical literacies that our age 
requires. 

To avoid the mistaken value of technology as a "Magic Lantern" 

Technology is a tool that is human made. Hence, it should not take the place of humans especially 
when dealing with humans. For example, teachers should not be replaced with machines. Learning should 
not be given to the hands of machines, only. The researchers and academicians (Postman, No Date) have 
always criticized the notion of technology as being seen like a magic lantern. Dockterman (1999) stresses 
the necessity of pointing to interactive classrooms and interactive technologies. 

Allen & Bloom (1997) argues that since technology changes so rapidly, the focus of researchers, 
educators, and designers should not be on computer hardware but on issues of cognition, & perception. 

What are the characteristics of "interactivity"? 




Rose (1999) searched for a list of characteristics of the term "interactivity" in learning 
environments. Her list includes the following (Table 1); 



NOTs... 


BUTs... 


Teacher controlled 


Learner controlled 


Lecture (where learner is passive recipient) 


Active learning through hands-on exploration 


Student as spectator 


Student as participant 


Feeding children information 


Letting them to find it for themselves 


Linear delivery 


Hypermedia Learning 


Instruction 


Construction 


Absorbing material 


Learning how to learn 


Passive 


Active 


Rigid 


Flexible 



Table 1 . Rose’s dichotomies for characteristics of ‘interactivity” 



She (1999) uses the expression “the privileged sphere of interactive learning” to point to the most 
general use of interactivity in the form of a “ideal” which highly motivates learners to explore. She also 
argues that we should try to achieve rationality. As in her saying, a new form of Socratic Dialogue! so that 
learner’s role is not only to follow the Socrates’ logic, and to express agreement rather mindlessly when 
required to do so, but to pose some questions to break down Socrates’ rationale to construct new student 
knowledge. This new form also brings the theory of constructivism in to the scene so as forgetting the 
notion and possibility of a true nature of knowledge and excellence, but it lets the student lose his/her way 
and facilitate the learning environment to open a field of provoked and free mind, to the new insights and 
ideas of students’ own. Another interpretation would be the student engagement with the instructional 
activity and/or learning activity. Other than learning theories, recently Engagement Theory seems to have a 
basis for "interactivity", too. Hannafin (1989, cited in Stemler, 1997) argues that cognitive engagement in 
interactive multimedia can be achieved through use of fault-free questions, queries, real-time responding, 
note-taking, predicting/hypothesizing, hypertext, and cooperative dialogue. Bangert-Drowns & Pyke (1998) 
argue that engagement may be thought as in the form of mobilization of cognitive, affective, and 
motivational strategies for interpretive transactions with text. Sims (1999) argues that the concept of 
interactivity should not be thought without the idea of user engagement. 

Learner control is a highly controversial issue. Rose argues that if it is "learner control" in the 
same sense of "weight control" and "flood control", then this means that we deal with control of the learner 
instead of the control by the learner. Since, weight control means control of the weight, and flood control is 
the control of the flood, instead of vice versa. Research indicates that instructional design developers 
should try to avoid control of the learner to achieve higher levels of interactivity. But this brings the 
question of difficulty of the organization of the design and the restraints in design elements. 

Stemler (1997) argues that common view about interaction being stimulus-response reinforcement 
encounters between the learner and instruction. Schwier & Misanchuk (1993, cited in Stemler, 1997) gave 
the examples of behavioral orientations to instructional interaction as designer imposed pacing, over 
responses, immediate feedback, knowledge of results, controlled sequencing, small step size, promoting, 
and conversation. Here, one needs to notice that designer imposed pacing is not in parallel with control by 
the learner but with control of the learner. 

Regarding feedback, as one of the most important characteristics that is essential for 
"Interactivity", Stemler (1997) says that, Gagne’s nine events of learning that have been recommended, in 
one way or another, by a multitude of multimedia researchers. These events of learning include gaining 
attention, informing learner about objectives, activating motivation, stimulating prior learning, presenting 
stimulus material, providing guidance, eliciting performance, providing feedback, assessing performance, 
enhancing retention, and learning transfer. Mainly the multimedia developers to achieve some degree of 
interactivity have used these events of Gagne. Park & Hannafin (1993, cited in Stemler, 1997) argue that 
feedback should be included in the environment but with some cautions. First of all, it should not narrow 
the learner’s focus to only one content covered in the question-feedback cycle. Secondly, feedback needs to 
emphasize information that is conceptually relevant rather than explicitly or absolutely “correct”. 

Wittrock (1974, cited in Stemler, 1997) on the other hand argues for intentional selection of 
information, as a must to achieve interactivity. A similar argument by Orr, Golas & Yao (1994, cited in 
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Stemler, 1997), states that opportunity for interaction in every 3 or 4 screens of in 1 minute, chunking the 
content, building in questions (feedback, also) reviews, summaries, for each segment, asking students to 
apply knowledge, using thought-provoking questions, and provoking curiosity in learner through active 
exploration. But, aren’t these somehow contradictiry with the control by the learner issue? 

Some research studies only consider human-computer communication for understanding 
interactivity. Rafaeli & Sud weeks (1999) states that it has a continuum from one-way communication on 
one hand, and to the two-way communication on the other hand. 

Interactivity and Design 

Sims (1999) argues that interactivity can be perceived as an art. He also states that this is because, 
it requires a special understanding of the learner, an appreciation of software engineering capabilities, an 
importance of rigorous instructional design, and the application of appropriate graphical interfaces. 

Sirohi( 1 999) points to the importance of JAVA applets for preparing "interactive" learning 
environments especially on the web. Sirohi's ideas seem to parallel the idea of computers as at the end of 
the teaching machine era and at the beginning of the learning machine era (Barker & Tucker, 1990; cited in 
Rose, 1999). He states that Java as an object-oriented language, is the platform for preparing interactive 
simulations generally. She argues that John Dewey may be thought as the advocate of interactivity cause it 
is somehow regarded as “learning by doing.” According to Sirohi two types of framework especially are 
regarded as “interactive”. And these are -information delivery with online communication, and immersive 
collaborative environments as MUDs, and computer conferencing. 

Milheim & Lavix (1992, cited in Stemler, 1997) stress the need for one button access to a 
progress chart or map showing the students’ location in the program. Poncelet & Proctor (1993, cited in 
Stemler, 1997) give guidelines for interacting help keys, answer key, glossary key, objective key, content 
map, options key, test key, next lesson key, menu key, exit key, summary key, review key, example key, 
etc. 

Stemler (1997) argues that possible match or mismatch of user expectations and the actions on the 
screen determine the learner’s concentration on the material rather than on screen design & how it works. 
The idea of learner control has many effects on the design issues, too. Overbaugh, 1994; Schwier & 
Misanchuk, 1993; Hannafin, 1984; Litchfield, 1993; Laurilliard (1987), Orr, Golas, & Yao (1994), 

Sweeters (1994) (all cited in Stemler, 1997) argue that the number of keys, the place of those keys, the 
number of animations, the match between text and attached pictures, etc. all shape the learning experience, 
and hence the degree that the learning environment may be called as interactive or not. Learner control 
seems to be defined as allowing learners to access information, that is selected and restricted by the 
designer or teacher, as flexible as possible. The designer should not give them time, opportunity or chance 
for the learners to be lost. In other words, designer or teacher should leave one line of footprints for learners 
to follow, and make them think they have the opportunity for control. But, while doing this, he/she should 
put the story into a restricted environment wherein the child cannot change and has to obey the rules, and 
hence no room/space for imagination & creativity. This conflicts with the research that mentions very little 
learning occurs when students are left to explore information on their own with no guidance (Merrill, Li & 
Jones, 1990, cited in Stemler, 1997). 

Rhodes & Azbell (1985) name three levels of interactivity for design issues. They are: Reactive 
(little learner control of content structure with options and feedback), Coactive (learner control for 
sequence, pace and style), and finally Proactive (learner control for both structure and content). Sims (1994, 
cited in Sims, 1999) on the other hand, identifies different levels. These are: object interactivity (objects are 
activated), linear activity(user’s ability to move through a predetermines sequence), support interactivity 
(opportunity to receive performance support), update interactivity (dialogue between learner and the 
material), construct interactivity (creation of an instructional environment), reflective interactivity (seeing 
the answers and comparing them with others), simulation interactivity (individual determines the 
sequence), hyperlinked interactivity (correctly navigating through a maze of information), non-immersive 
contextual interactivity (meaningful, job related context), immersive virtual interactivity (computer- 
generated world). 

Similar studies on animation, audio (Sponder & Hilgenfield, 1994; Hannafin & Rieber, 

1989; Rieber, 1994; Orr et al, 1994; Kensworthy, 1993; neugent, 1982; Wright, 1993; Ipek (1995) all cited 
in Stemler, 1997) point to the place and the degree of relevance of those materials to the actual course 
material to have real interactive value behind. Over all, simplicity seems to be the most important 
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characteristic of the interactive multimedia design. In this line of research, another main issue seems to be 
the rigid structures of multimedia development. Even though, if they would try to chance the design 
structures, the multimedia design software would not give them enough chance, for doing it effectively. 

Methodology 

A group of academicians and researchers were asked to make one wish to the Genie of Aladdin's 
Lamp for "Richly Interactive Learning Environments". Interestingly, they are wish they hand in common 
way to come up with a shared understanding of the term "interactivity". They mention ranges from 
"interactivity as an intellectual activity" to "interactivity as a communication issue". Seeing the range of 
their ideas, they all argued that the argumentation of Rose was correct and we need a shared theory and/or 
understanding of the term "interactivity" for the new millennium. 

They mentioned the necessity of time and material, and budget for interactivity to be achieved to 
the fullest degree. But they also argued that cooperation as in the form of communication in a variety of 
learners, in which the learners have the capability of observing, experimenting, debating, playing, 
navigating with and within a huge information system. A laboratory or a field site, a dream world that 
everything is possible, a holographic n-dimensional shared environment, with a lot of opportunities for 
hands-on experiences or manipulatives, or a classroom with real world happenings, within the framework 
of integrated mathematics and science curriculum. Communication in the form not only oral, but also, 
written, and visual. Technology for the interactivity is considered as a tool but not as an aim to achieve. 

They seemed to have some disagreements about the degree of structure. Some mentioned that it 
should have lots of structure, some said that it should have no limits. Feedback was conceived as a form of 
structure that should be built in to the environment. Especially, feedback was assumed to be taken by the 
experts in the domain through the help of the technology, not only from a teacher or only from a software. 

Learners were conceived as both creators and players of those environments. To achieve this, 
making learners to have some personal learning goals were the main idea behind the discussion. 

Conclusion 

Interactivity is not a word, that its identification should be left only to instructional design 
developers. In mathematics and science education, the ideas that it is associated with are directly related 
with learning issues, and hence should be carefully considered. 

Kirsh (1997) points to the theory of interactivity as being in the early stage of development. He 
also gives some additional ways of interacting with the environment as preparing the environment, 
maintaining the environment, and reshaping the inherent cognitive structure of the environment. With these 
in mind, and the possibilities that the new technologies bring to the learning issues, the development of 
highly interactive learning environments, may mean enabling learners to possess the environment to shape 
it with respect to their own learning styles, interests, and aims. In this way, we may cover the problem of 
the need for a settled view of interactivity as Rose (1999) and Kirsh (1997) suggests. 

However, it should not be overlooked that a new definition without an understanding of the old 
and recent ones would result in a new definition, that is useless. To avoid this, we have thought that we 
may gather the data from researchers and academicians in the universities, to have a much more shared and 
excepted theory of interactivity. This would help us to solve the problems like different interpretations 
within the same domain. If "interactivity" would be a key term in the effective learning environments, then 
we need to come up with a theory behind it. 
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Abstract: This paper reports the findings of a study, a pilot study, conducted in a 
childcare center in Whitewater, WI. Eight children were involved and divided into two 
groups: control and experimental groups. Quantitative and qualitative methodologies 
were used to analyze the data collected from pre- and post tests and interactions of a child 
with a computer. Findings show that children who are observed and helped by a teacher 
gain mathematical concepts faster and more efficient than those who are completely left 
alone at the computer. This pilot study implies that the teacher needs to pay attention to 
children at computers while working with or supervising children doing other activities. 
An extended study is suggested to replicate the findings of this pilot study. 



Introduction 

In our contemporary society, it is not surprising to see a child manipulating a computer at preschool or a 
primary classroom setting. Research has shown that computers help children learn (Clements, Nastasi, & 
Swaminathan, 1993; Davidson & Wright, 1994; Haugland, 1992; Haugland & Wright, 1997; Hohmann, 
1994; Hoot, 1986; Grabe & Grabe, 1998; Wright & Shade, 1994). Pertinent research findings will continue 
to inspire more schools to invite computers into classrooms. Concurrently, however, questions and 
concerns surface as developmentally appropriate use of computers in children’s learning is taken into 
consideration. Some of the questions and concerns, for example, are: “How can a child learn with a 
computer on his or her own in an effective and efficient manner?” “Is it developmentally appropriate to 
leave a child alone or unnoticed at a computer?” “What is developmentally appropriate practice associated 
with the integration of computer technology into children’s acquisition of knowledge?” To attain answers 
to the questions, a former colleague and I conducted a pilot research study. 

The Pilot Research Study 

Setting : We conducted our research in a preschool classroom of a child care center where the enrollment 
differentiated daily: A number of children were full time every day throughout every week. The rest of the 
children came to the center either on Mondays, Wednesdays, and Fridays or Tuesdays and Thursdays. We 
went to the classroom mostly on Tuesdays and Thursdays. 

Getting Consensus : Before this research project started, one of us casually talked with the classroom 
teacher and the director of this child care center. With their oral permission for us to conduct the research 
project in this 4- and 5-year-old classroom, we scheduled an official meeting with the classroom teacher 
and the director, expressing the detailed information about the research project. This meeting was followed 
by two written permissions: one was from the director with the other from the classroom teacher. Having 
received the written permission, we sent out the consent letters to the parents of the children. Included in 
the permission slips also were a series of survey questions with respect to children’s mathematics concepts 
from their parents’ perspectives. Before the research study, we also asked the classroom teacher to reveal 
the knowledge of each child’s mathematic level. The parents’ perceptions of their child’s level of 
mathematics combined with that of the teacher determined the eight selected subjects in the research. 

Subjects : There were eight children involved in the study. The subjects were ages 4- and 5-year old (see 
Table 1. Note: We employed the pseudonymity to safeguard the subjects in any form of publication). The 
average age was 5. 175 (n=8). The mathematic concepts that each chosen child possessed were roughly 
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alike. The selected children basically had little understanding of six categories of mathematical concepts, 
including numbers, sizes, shapes, matching, patterns and numerical counting 1-10. The selection enabled 
us to test the influential power that computers had on children’s mathematic inquiry. 

Table 1 



Name 


Aee (Yr.Mo) 


Name 


Aee fYr, Mo) 


Reed 


4.11 


Neth 


4.9 


Adam 


5.6 


Ade 


4.7 


Emy 


5.3 


Tyler 


5.7 


Sara 


4.10 


Dane 


5.1 



We randomly divided the eight children into two groups, one control and one experimental. There were 
two computers placed in the classroom. The children from both of the groups had opportunities to 
work/play at computers. While a child from the control group interacted with the computer, a child from 
the experimental group worked with the computer observed by a researcher. 

Instrument : Our research study was a quantitative and qualitative study, intending to examine the effect of 
a teacher’s presence on children’s mathematics learning with computers. A quantitative methodology was 
used in pre- and post-tests before and after our research project. We developed a rubric, with which we 
used to measure the results of the tests. However, when being with the children at the computer, we were 
unable to measure the occurrence with a pre -determined instrument because the occurrences were not fixed 
numerals. Therefore, the instrument of this part of our research was us, the researchers. 

Data Collection : We administered pre- and post-tests before and after the subjects learned mathematics 
concepts with computers. The tests’ scores were recorded. When the pre- and post-tests were administered, 
while one researcher reset up the materials for a test, the other was responsible for bringing a child to a the 
table where the test was given from either playground or from a learning center. We used unifix cubes with 
different colors, including red, green, yellow, and orange, to examine the children’s understanding of 
patterns, and numerical counting. The subjects were asked to build with the uni fix cubes following a 
pattern assembled in advance by one of the researchers (In addition to the six pre-assembled cubes (red, 
green and yellow, each child was expected to add six more) and then to count the number of the assembled 
unifix cubes (Each child was asked to count to 10). Then, this same child was given two plastic bag, each 
of which was filled with a number of plastic forks, plastic knives, plastic colorful shapes with two obvious 
different sizes adopted from a commercially produced attribute block box, sugar packages, and straws. 

The task of this child was then to pair items from the two bags. This activity intended to examine the 
children’s abilities in terms of matching, shapes, and sizes. The provided shapes included square, 
rectangle, triangle, and circle. The final test item was to have the children identify numbers 1-10 that were 
neatly and clearly printed on a piece of paper. 

Each child from both of the groups worked at a computer for four times, with each session lasting 
four 20 minutes. The children from both groups interacted with the provided software Mille’s Math House 
produced by Edmark. This software was designed for preschoolers to enhance their awareness and 
understanding of basic mathematical concepts, including counting, numbers, shapes, and sizes. We took 
notes when each subject from the experimental group was learning with a computer but we did not give 
direct attention to the subjects from the control group. The notes were taken at the time when each subject 
began to learn with the computer to the time when each subject finished at the computer. While notes were 
being taken, we also used a video camera to record the process. Therefore, in addition to pre-and post-tests, 
our investigation also employed naturalistic observation to capture ways that children learn mathematics 
with computers. 

Data Analysis : Naturalistic observation data of children’s acquisition of mathematical concepts with 
computers provided us with valuable information. We reviewed our recorded data — notes and video taped 
data each time after a daily segment of the research project was completed. We compared with our notes to 
categorize and code the data in order to look for patterns. To analyze children’s inquiry of mathematics, we 
developed a coding system involving five categories: numerals, counting, shapes, sizes and matching. We 



coded the videotape and note of each child’s working with the computer; we closely examined each of the 
target children as individual case studies to provide a kind of “think description” (Greertz, 1973), that is, 
we focused on the child’s reaction to the section that he/she picked to play. In the analysis process, we 
were conscious of reliability. Our view is that reliability involves the community of scientists in reliable 
interpretations that were rationally and sensibly derived from the weight of the evidence that we collected 
(Ginsburg, Klein, & Starkey, 1998). We implemented this by viewing as a group the video segments of a 
child’s working at the computer; next, each of us presented interpretations with specific and sufficient 
evidence to support the interpretations. We also compared the results of the pre- and post-tests to examine 
the impact that the computer had on children’s learning of mathematics. 



Results : This research centered on the examination of the efficacy of the role that the teacher plays in 
children’s acquisition of mathematics with computers. We conducted this research by staying with the 
children from the experimental group throughout. The principle was to closely observe the children 
working at the computer but to intervene at the right moment with questions that we considered as 
simulators. The questions that we posed and the intervention that we created were helpful in assisting the 
children to acquire concepts efficiently. Table 2, 3, 4, and 5 manifest the results of pretest and posttest 
taken by the children from the control and experimental groups. Table 2 and 3 demonstrate raw scores that 
the children from the experimental group produced whereas Table 4 and 5 revealed the raw scores of pre 
and post tests that the children from the control group gained. 

In patterns, we provided three colors of unfix cubes, i.e., red, green and yellow. These three colors 
were constructed together in the order as red, green, yellow, red, green, and yellow. The children were 
expected to put together the same patterns. If a child had five colorful unifix cubes assemble in the ordered 
fashion, that is, red, green, yellow, red and green, he or she got 100 points. In matching, four shapes were 
offered. They were triangle, circle, square, and rectangle. If a child was able to match two different sets of 
the same four shapes, he or she had 100 points. The same token was applied to shapes, with 25 points each. 
In counting, if a child was able to count one to 10 without making a mistake, 100 points were given. The 
same rule was applied to testing of numbers. If a child recognized the printed numbers from one to ten, he 
or she attained 100 points. 



Table 2 



Name 


Patterns 


Matching 


Shapes 


Counting 


Numerals 


Total 


Reed 


20 


75 


100 


100 


70 


365 


Adam 


0 


50 


75 


80 


80 


285 


Emy 


80 


100 


100 


100 


90 


470 


Sara 


60 


75 


100 


100 


60 


395 


Total 


160 


300 


375 


380 


300 


1515 



Table 3 



Name 


Patterns 


Matching 


Shapes 


Counting 


Numerals 


Total 


Reed 


80 


100 


100 


100 


90 


470 


Adam 


60 


75 


100 


100 


100 


435 


Emy 


100 


100 


100 


100 


100 


500 


Sara 


100 


100 


100 


100 


80 


480 


Total 


340 


375 


400 


400 


370 


1885 



Table 4 



Name 


Patterns 


Matching 


Shapes 


Counting 


Numerals 


Total 


Neth 


40 


75 


75 


90 


80 


340 


Ade 


60 


75 


75 


80 


70 


360 


Tyler 


60 


100 


75 


100 


90 


455 


Dane 


80 


100 


80 


90 


90 


440 


Total 


220 


350 


305 


360 


360 


1595 
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Table 5 



Name 


Patterns 


Matching 


Shapes 


Counting 


Numerals 


Total 


Neth 


40 


100 


100 


90 


80 


410 


Ade 


80 


75 


75 


80 


70 


380 


Tyler 


80 


100 


100 


100 


90 


470 


Dane 


80 


100 


80 


90 


90 


440 


Total 


280 


375 


355 


360 


330 


1700 



The comparison of the grand total from Table 2 and Table 4 unveils that the children from the control 
group had a higher level of mathematical knowledge than those in the experimental group. With the 
supervision and intervention of the researchers at the computer, the children’s mathematic scores in the 
experimental group increased from 1515 to 1885, having 14% growth mathematically (see Table 6 or 
Figure 1 and 2). The mathematical concepts that the children from the control group gained were not 
dramatic. The raw scores grew from 1595 to 1700, increasing 5%(see Table 6). Individual mathematic 
achievement also bears differential outcomes. 



Table 6 



Name 


Before Test % 


After Test % 


Increase % 


Control Group 


63 


68 


5 


Experimental Group 


61 


75 


14 



Figure 1 
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Table 7(or Figure 3 and 4) shows the general progress level of the individual subjects from the two groups 
in the inquiry of basic mathematical concepts before and after the treatment. 



Table 7 





Control Group 


Experimental Group 


Name 


Neth 


Ade 


Tyler 


Dane 


Reed 


Adam 


Emy 


Sara 


Before 

% 


68 


72 


91 


88 


73 


57 


94 


79 


After 

% 


82 


76 


94 


88 


94 


70 


100 


96 


Increase 

% 


14 


4 


3 


0 


21 


13 


6 


17 



Discussion : The focus of this research was on the effects of the presence of a teacher on children’s 
construction of mathematical concepts with computers. The software Mille’s Math House especially 
designed for preschoolers was chosen for this purpose. Eight subjects participated in this study with four 
randomly included in the control group and the rest in the experimental group. Two computers were moved 
into the preschool classroom for the subjects to manipulate. While each child involved in the study has a 
chance to play with the computer. The difference was the child at the computer from the control group 
might have his or her friends to join him or her, whereas the child from the experimental group had the 
researchers to accompany him or her. The researchers observed the child and provided necessary assistance 



Figure 3 



Figure 4 
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Croup 




when it was appropriate time. The researchers also, at the right moment, intervened with provocative or 
stimulated questions in order to prompt the child’s understanding and thinking. For example, Adam had 
trouble recognizing the numbers 6, 9, and 10. As Adam chose the section of the software “Drawing a 
Caterpillar, the researchers closely watched him and lent him a hand whenever it was a right teachable 
moment. Our presence and questions reinforced his understanding. His each achieved success built in him 
the confidence and encouraged him to explore more in depth. In the process of Take another example; 

Sara had difficulties in construct patterns. The pretest enabled us to follow her and provided her needed 
support and help whenever it was necessary. Her scores on Patterns increased from 60 to 100. Like the 
children from the experimental group, the children from the control group had the same amount of 
opportunities working with the same software. However, success, compared with the experimental group 
children, was little. For example, Reed had 40 points on Patterns, and 80 points on Counting and 
Numerals, respectively. After working with the computer, his posttest scores in these aspects remained the 
same, although he gained in Matching and Shapes. This situation occurred because Reed and his joined 
friends commonly found patterns and numerals difficult areas to comprehend. They might explore the 
sections of patterns and numerals. However, without proper expertise helps, Reed or his friends might 
quickly wanted to quick as they encountered “complex” situations that they did not conceive that they had 
capabilities to resolve. Although they might have attempted to give a few tries to the emergent problems, 
they were discouraged by not being able to attain right answers or apply right ways to work on the section. 

Conclusion 

Although it has been commonly recognized that computers develop children cognitively and 
intellectually (Clements, Nastasi, & Swaminathan, 1993; Davidson & Wright, 1994; Haugland, 1992; 
Haugland & Wright, 1997; Hohmann, 1994; Hoot, 1986; Wright & Shade, 1994), attentiveness should be 
given to developmentally appropriate practices (DAP) (Bredekemp,1987; 1997) in teaching and learning 
with computers. DAP suggests that to bring about effective results of inquiry, it is fundamental that a 
teacher understands the level and status of children’s learning and how children retain concepts. Knowing 
about a child individually is conducive to promoting children’s positive desire of deepening knowledge 
about the world around them. Vygotsky (1978) advises that a child is able to comprehend a certain thing on 
his own but needs an adult’s help to reach maximal effect. Vygotsky’s theoretical framework, Zone of 
Proximal Development (ZDP), sustains the conception that the role of a teacher builds a driving force in 
children’s positive disposition to learn and that an adult should be a part of a child’s learning process. 
Completely relying on himself, a child may feel discouraged when facing emerging problems that are 
difficult to solve alone by his limited amount of knowledge. Because of a limited and restrained body of 
know-how and understandings, a child is unable to govern successfully a learning process and resolve 
dilemmas unless the availability of the adult’s attention and awareness exist. Provided that inability to do 
away obstacles that a child encounters undermines the confidence of the child to continue exploration of his 
interest, the perception that learning is unconquerable incubates as a result of constant failures. The 
availability and accessibility of the teacher’s timely “rescue” may avoid this troubling phenomenon. A 
timely assistance is from the observance and from flexible thinking of the teacher. 

To enhance children’s learning, the teacher needs to be alert not only to children at traditional 
learning centers, but also to children at a computer center. Absolutely depending on children’s autonomy at 
a computer is an inappropriate instructional approach. Inadequate amount of knowledge in academic 
domains and lack of computer techniques may possibly overthrow a child’s initial excitement in learning. 

A teacher’s ignorance of what is ongoing at a computer and of the demands each child holds about a 
computer can counterblow the child’s determination of working with computers. A teacher’s interruption at 
right moment rescues a child from an otherwise disaster dilemma at a computer (Chang, 1996). Intervening 



at the right moment results from constant and attentive observation of the teacher and a sufficient body of 
knowledge that the teacher possesses about her children (Chang, 1996; Edwards, Gandini, & Forman, 
1993). The quality of the teacher's work is followed by the increased confidence that children embrace. 
Highly self-assured feelings ensure the continuation of exploration that is the basis of extension and in- 
depth of understanding of concepts (Chang, 1996), 

Although this research, a pilot study, results in a positive gain in terms of children’s learning with 
computers with the attention from the teacher, the finding needs to be examined and tested. A future study 
may be considered to involve a large sample. 
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Abstract: This study compared science students who were exposed to traditional methodology 
with those who received traditional methodology supplemented with computer-assisted instruction 
(CAI). From the 24 conclusions, an overall mean effect size of 0.266 was calculated, indicating 
that, on the average, students receiving traditional instruction supplemented with CAI attained 
higher academic achievement than did 60.4% of those receiving only traditional instruction. The 
effect sizes were categorized into four subject areas. In descending order, the mean effect sizes in 
general science, physics, chemistry, and biology are: 0.707, 0.280, 0.085, and 0.042, respectively. 
Differences in educational settings revealed that CAI is most effective among science students in 
urban areas; followed by those in suburban areas; and weakest among rural students. However, a 
-0.335 correlation between effect size and years indicates that the effect of CAI on academic 
achievement has declined during this period. Some of the findings were reported in Christmann and 
Badgett (1999). 



Introduction 

Since the 1970s, the American educational system has been besieged with criticism from the American 
public. In response to this criticism, the Bush administration created America 2000, a plan designed to ameliorate 
problems within the fading scholastic establishment of America. The Presidents Committee, inherent within 
America 2000, set forth goals including that by the beginning of the 21st Century, America's students would be 
ranked first in the world in science. 

More recently, however, the Third International Mathematics and Science Study (TIMSS) reported another 
continuing truth about the waning science achievement of America's students. In summary, the report furnished little 
hope that America's students would be ranked first in the world in science achievement by the year 2000 (TIMSS, 
1997). 

American education is at a crossroads; current direction must be examined to reclaim the future competitiveness 
of American students. Educational research resounds with reports that have examined the effectiveness of 
computers in education, providing evidence that computers are valuable aids in the enhancment of student learning. 
Hence, much of the past research concentrates on a diverse latitude of subjects and settings. However, researchers 
are now able to examine prior findings within the context of the present through the statistical technique of meta- 
analysis. 

The United States is in the process of entering a period of major change, in which a metamorphosis in 
demographics, shifting world commerce, updated technologies, and an emerging world order all suggest that a 
reorganization for our schools should be considered. Indeed, Mauriel's (1989) research suggests that students differ 
not only because of their social, economic and demographic backgrounds, but because of their educational 
environments as well. 

Christmann and Badgett (1997a) suggest that further research is necessary to determine whether computer- 
assisted instruction (CAI) is comparatively more effective in different subject areas. In compliance with this 
suggestion, the purpose of the present study was to compare the contributions of CAI to student achievement in a 



variety of science disciplines across differing educational settings. Thus, the study has disclosed those areas where 
CAI is more, as well as less effective than traditional methods of instruction. 

Statement of the Problem 

The necessity for improving science achievement in the American secondary schools was the catalyst for 
conducting this meta-analysis of all available science CAI research pertaining to computer-assisted instruction in 
varying educational settings. The study has focused on the following research question: 

What differences exist between the academic achievement levels of science students who 
were exposed to computer-assisted instruction, and those who were not exposed to this 
instruction within the academic areas of general science, biology, chemistry, and physics 
within three demographic settings. 

The research evaluated the effectiveness of CAI on the science achievement of students across four science areas 
within urban, rural, and suburban demographic settings. Additionally, a comparison was made between the 
effectiveness of microcomputers and traditional instructional methods. 



Methodology 

The compiled data from the studies were analyzed through a meta-analysis technique, a secondary statistical 
analysis or re-analysis of previous research, which is used as a vehicle for answering new questions through existing 
data (Glass, McGaw, & Smith, 1981). In essence, it is a quantitative application of deduction that would have been 
impossible through any other previously known methodology (Borg & Gall, 1989). 

Locating of documents . The studies examined in this research were selected from a computer search of the 
databases ERIC (1966 - March 1999), Dissertation Abstracts (1861 - August 1997), and PsychLit (1974 - 
September 1997). These databases were searched with the keywords “science;” “traditional;” “computer-assisted 
instruction;” “CAI;” and “achievement,” which identified over 1000 studies to be reviewed for inclusion in this 
meta-analysis. 

The studies included in this research met the following predetermined criteria: 

1) they were conducted in an educational setting; 

2) they included quantitative results in which 
academic achievement was the dependent variable and 
microcomputer-provided computer-assisted instruction 
was the treatment; 

3) they had experimental, quasi-experimental, 
or correlational research designs; 

4) the sample sizes had a combined minimum of 20 
students in the experimental and control groups. 

Eleven relevant publications met the predetermined criteria for incorporation within this meta-analysis; 
whereas rejected studies did not meet all four selection criteria for inclusion. The majority of those CAI publications 
that did not meet the criteria for integration into the study did not statistically analyze the reported data. 

Analysis 

As previously mentioned, the data were analyzed through the meta-analysis procedure, a technique that relies 
heavily on the calculation of effect sizes for establishing statistical meaning (Wolf, 1986). According to Glass et al. 
(1981), effect size is the degree to which a phenomenon is present in the population of the study. In meta-analysis, 
effect size is calculated to determine the presence of a statistical difference between mean standard deviation units 
(SDx) (Wolf, 1986). 
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Table 1 



Content Area, Sample Size, and Effect Size of Each Study 



Author(s) Content Area n ES 



Carnes, et al. 
Dumin, R. 
Dumin, R. 
Dumin, R. 
Dumin, R. 
Emerson, I. 
Glenn, C. 
Hauben, et al. 
Hauben, et al. 
Hauben, et al. 
Hauben, et al. 
Hauben, et al. 
Hauben, et al. 
Hauben, et al. 
Hauben, et al. 
Hauben, et al. 
Hauben, et al. 
Horton, et al 
Hounshell, et al 
Lu, C. 

Lewis, et al. 
Morrell, P. 
Morrell, P. 
Yalcinalp, et al. 



Physics 

Gen. Science 

Gen. Science 

Gen. Science 

Gen. Science 

Biology 

Gen. Science 

Chemistry 

Chemistry 

Chemistry 

Chemistry 

Chemistry 

Chemistry 

Chemistry 

Chemistry 

Chemistry 

Chemistry 

Gen. Science 

Biology 

Biology 

Gen. Science 

Biology 

Biology 

Chemistry 



100 


0.280 


154 


0.928 


154 


1.360 


154 


1.000 


154 


0.857 


122 


0.371 


300 


0.600 


56 


-0.338 


54 


0.194 


54 


0.507 


53 


0.616 


56 


0.429 


56 


-0.048 


55 


-0.256 


53 


-0.842 


54 


-0.107 


54 


0.094 


43 


0.049 


202 


0.438 


56 


0.030 


148 


0.156 


56 


-0.142 


54 


-0.485 


101 


0.685 



Meta-analysis 

Eleven of over 500 studies met the predetermined criteria for inclusion in this meta-analysis. Table 1 presents the 
content area, sample size, and the mean effect sizes for each study. A total of 2343 students participated in eleven 
studies, which resulted in 24 conclusions. The sample size ranged from 43 to 300; the mean sample size was 98 
students. 

Mean Effect Sizes 

From the 24 effect sizes calculated, an overall mean effect size of the meta-analysis was also calculated. The sum 
of the 24 effect sizes is 6.376. The mean effect size of 0.266 is positive because higher scores were attained by those 
science students receiving CAI. However, Cohen (1977) classifies this effect as small. 

Wolfs (1986) graphical interpretation of average effect in SDx units for the comparison between the traditional 
instruction group and the CAI group indicates that the average student exposed to CAI showed academic 
achievement that was greater than that of 60.4% of those students who were exposed to traditional instruction. 
Moreover, the typical student moved from the 50th percentile to the 60.4th percentile when exposed to CAI. 

The 24 mean effect sizes across the differing content areas (see Table 2) were catagorized into four content areas, 
and the mean effect size was calculated in each of the subject areas where the effects of CAI on academic 
achievement were studied. The mean effect size of CAI on general science students' academic achievement was the 




104 



largest effect size in the meta-analysis, when comparing the effects between CAI and traditional methods of 
instruction. In descending order, the mean effect sizes by subject area are: general science, 0.707; physics, 0.280; 
chemistry, 0.085; and biology, 0.042, respectively. 



Table 2 

Content Area, Sample Size, and Effect Size of Each Study 



Content Area 


ESn 


Effect Size (ES) 


Physics 


1 


0.280 


General Science 


7 


0.707 


Biology 


5 


0.042 


Chemistry 


11 


0.085 



Relationship Between Effect Sizes and Time 

A correlation for the data revealed that the mean effect size and progressive time span (in years) were 
significantly related, r = -0.335, n = 7, p > .05, two tails. Furthermore, Figure 1 displays a scatterplot showing a 
negative correlation between consecutive years and the effectiveness of CAI. 




Figure 1. Relationship between mean effecf^izes and years. 



Discussion 

This meta-analysis shows that CAI positively affects the achievement of science students in various content 
areas. Again, the specific objectives of the study were to: (a) select studies that utilized CAI as a supplement to 
traditional methods of instruction, (b) statistically analyze the studies through meta-analysis techniques, and (c) 
compare the effectiveness of CAI among different subjects and demographic settings. 

Comparing mean effect sizes and differing years. Studies included in this meta-analysis were conducted 
between 1985 and 1995. The 24 effect sizes examined ranged from a low -.842 to a high of 1.360. During the ten- 
year span, the overall mean effect size by year progressively decreased from 0.049 to 1.072 (see Figure 1), thus 
contradicting Mason’s (1984) belief in the relationship between technological advancement and academic 
improvement. However, this finding is in agreement with Christmann et al.’s (1997b) study, suggesting that 
decreases in effect size may be attributed to a widening between hardware and software development. Plausibly, the 



software implemented between 1985 and 1995 was not in conjunction with the high performance hardware. 
Moreover, from 1985 to 1995, microcomputers were rapidly improved through the development of more advanced 
microprocessors. Markedly, the calculated effect sizes reflect a downward trend in academic achievement during 
the 1985 to 1995 period. 

Mean effect size. The mean effect size calculation across the 24 conclusions of the 1 1 studies generated by this 
meta-analysis is 0.266. Cohen (1977) interprets this effect size as small. The difference in academic achievement 
resulting from CAI was an improvement of 10.4 percentile ranks from the central region of the distribution. Using 
this measure, it can be concluded that CAI is more effective than traditional methods of instruction in raising overall 
academic achievement in science content areas. This finding supports the research of Bangert-Drowns et al. (1985), 
which shows a positive effect of CAI on academic achievement in secondary schools. 

Comparing mean effect sizes by different science content areas. The mean effect sizes were tallied according 
to subject matter, showing that: one was calculated in physics; seven in general science; five in biology; and eleven 
in chemistry. When comparing CAI with traditional instruction, the largest mean effect size occured in general 
science (0.707), indicating that the average science student exposed to CAI attained academic achievement greater 
than that of 78% of those general science students exposed to traditional instruction. 

Computers and science achievement. Microcomputer simulations enable students to learn science through their 
actual experiences rather than through the transposed method of reading or the discussion of actual experiments. 
Here, students can complete experiments that are ordinarily considered hazardous, unworkable, or unrealistic. For 
example, simulations can engage students in research where an analysis of the genetic attributes of many generations 
is concluded within a single laboratory session. Other problems, such as experiments with motion, force, velocity, 
temperature, diffusion, osmosis, mitotic division, and population problems can be simulated by microcomputer- 
based software in a minimal time period at a nominal expense. Such simulations release students from time- 
consuming procedures so that they can intensify the comprehension and mastery of additional subject matter. 

Table 3 

Educational Setting, Sample Size, and Effect Size 



Content Area 


ESn 


Effect Size (ES) 


Urban 


1 


0.685 


Suburban 


18 


0.273 


Rural 


5 


0.156 



Different educational settings. The mean effect sizes were tallied according to demographic setting (see Table 
3). CAI appears to have its strongest effects among science students in urban settings; its effects are weaker among 
suburban students; and weakest among rural students. The mean effect size of the study in urban settings was 0.685. 
In suburban areas, eighteen studies yielded a mean effect size of 0.273, and a mean effect size of 0.156 was 
calculated across eight studies in rural educational settings. 

In conclusion. Educational planners should understand that meta-analysis is a method of reexamining existing 
research; it is not a forecaster of prospective developments in science education. Therefore, it should not be 
concluded, for example, that CAI will never be effective in raising student achievement in chemistry, or in any other 
subject area. Clearly, more research is needed to determine whether CAI is more or less effective among certain 
kinds of students or within certain academic areas, thus eventually leading to a more effective use of CAI among 
science students. Regretfully, however, only a paucity of comparative research has been directed toward this 
phenomenon in recent years. Specifically, as Miller (1999) laments “When policy is made, do people reflexively 
ask, ‘what does the research say?”’ Thus, it is imperative that immediate research be conducted to determine the 
effectiveness or ineffectiveness, of CAI in the science classroom of America’s schools. 
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ABSTRACT: Digital cameras in the science classroom can be used as a tool to enhance field trips. 
Field trips are meant to provide students with important hands-on experiences to further the goals 
and objectives of the curriculum. Many times they turn into no more than a day away from school. 
These trips can add value to the curriculum by providing pre-trip preparation, structured 
experiences on the trip, and experiences taken back to the classroom from the trip. The digital 
camera can be used to develop materials to use in preparation for the trip and record aspects of the 
trip to bring back to the classroom for further study. Although film based technologies can provide 
the same opportunities, the use of the digital camera provides a hassle-free way to capture, 
manipulate, and present images relative to the instruction. 



Field trips are designed to provide students with important hands-on experiences to further the goals and objectives of the 
curriculum. Many times these trips turn into no more than a day away from school. In order to add value to the curriculum, field 
trips should provide valuable content information to connect what is being studied in the classroom with the out of school world. 
Teachers must carefully plan the experience prior to the trip to include relevant content and methodologies related to the 
instructional experience. There are three distinct stages of a well-planned field trip. First is the pre-trip preparation of the 
students, second the experience of the trip and thirdly the use of the trip experiences in subsequent instruction. 

The pre-trip preparation includes an overview of the visit and tasks to be accomplished for further study after the trip. On 
the trip experiences should be structured so that they directly correlate with the experiences back in the classroom. The camera 
can be used to develop materials to use in each of these stages. Using a digital camera provides a relatively easy way to capture, 
manipulate, and present images to be used in the instructional process. Film based technologies can be used to provide these 
materials but is a much more cumbersome process. On the field trip, incorporating visual images enriches the experience by 
allowing the students to process information visually. This limits the need for students to write and make sketches of what was 
seen on the trip. Photographing with a digital camera provides images that can be viewed and/or downloaded immediately. 
Images can be analyzed in the field and if undesirable can either be retaken immediately or deleted. The ability to delete 
unwanted images and to manage storage space allows the user to get the picture they want and maximizes the number of usable 
pictures taken. Digital cameras save pictures in standard JPEG format, which is compatible with a wide variety of computer 
programs and can be directly inserted and integrated into word processing, database, desk-top publishing and presentation 
programs. Cost of image use, following the initial outlay of funds for a digital camera and storage device (flash card or floppy 
disk) is minimal. Therefore, one time funding provides equipment and materials for use over several trips and years. 
Eliminating continuous costs encourages teachers and student to use the camera frequently. 



Using the Camera as a Pre-trip Tool 

Using the camera to develop pre-trip activities requires teachers to produce material to provide the students with an 
overview of the coming experience. Pictures of the site to be visited serve as an advanced organizer or anticipatory set to the 
field trip. These materials can be used to prepare students to pursue problem tasks in small group investigation on the trip by 
providing images of actual examples of what they will see. This will help the teacher explain the tasks to be studied in the 
context of the trip. Presetting of the task eliminates the need to use valuable time on the trip. As these tasks are being set, they 
should be integrated into the content of the curriculum that the field trip is to complement. During instruction, a lesson on the 
specific concepts that provide the prerequisite skills necessary for a task, or observation, could include the images from the 
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location of the trip. When working on concept development (giving examples and non-examples), images from the field trip 
location could be included. Use of a digital camera can provide images for first observation opportunities. Often times when we 
first observe something, we do not know what to look for. Using these images the student can note specifics and then on the trip 
they can focus on these specifics and go beyond them. 



On the Field Trip 

Using the camera on the field trip provides the opportunity to preserve aspects of the experience that can then be brought 
back into the classroom for further study. While on the trip students can document their investigations by taking pictures of 
relevant experiences. They can gather images of specific items that have been predetermined to fit into a database of 
information, and to look for trends, patterns and functions. Finally they can use the images to record events, not limited to those 
which have been predetermined, that will be used for future study when back in the classroom. 



After the Field Trip 

After the field trip the student could use the digital images taken on the trip in follow up classroom lessons to complete the 
tasks started in the field. The use of field manuals to identify the specific species observed and to look for similarities and 
differences in members of a population are examples of this type of task. Students can develop presentations of their 
investigations in either a show and tell experience at the primary level or a report of the study that would incorporate both text 
and images at the middle grades and secondary school levels. On a field trip designed to collect information for further study the 
images would provide an important part of the base for subsequent instruction. In tasks focusing on research of specific topics, 
the images provide data to either support or refute pre-field trip hypotheses and suggest other hypotheses for investigation. 



Illustrations of Three Field Trips 

Three field trips that can be taken in the K-12 situation will be used to illustrate the use of the digital camera as an enhancement 
for the experience. At the early primary level, field trips are taken to explore the student’s community and its workers; an 
example of a field trip to a local beekeeper will be used. The middle grades, where field trips provide students with an 
opportunity to simulate activities done in the world of work, the example will be a study a biological habitat of a coastal barrier 
island. The secondary field trip, designed to bring content into the classroom to analyze, will investigate the integration of 
geometry into the structural design of the community and its buildings following a visit to a city or construction site. 



Primary Grades 

At this level, social studies objectives focus on the community and the interdependence of its members, science is working 
on process skills such as classification and observation and the content objectives of the animal life around us, and math is 
working on serration and classification. The study of honey and its production is an appropriate topic and one that will capture 
the student’s interest. The study should include the process and sequence of honey production, the care of the insects, and the 
distribution of the products. A pre-trip presentation of the overview will familiarize students with what they will see. There are 
many things the students can do and see on a trip to the bee yards, including the bees. They need to know safety behaviors to 
eliminate startling the bees and to reduce the chance of getting stung. Young children viewing bees for the first time may 
become excited, crowd around the bees to get a closer look or run away in fear. The beekeeper will smoke the bees to make them 
less active. Children made familiar with the purpose of smoking and what the bees and the supers look like through digital 
images before coming on the field trip can remain calm and take turns viewing the live bees without pushing and shoving, or 
showing signs of fear that may alarm the bees. On the trip, students will be given a chance to view the bees, the extraction of the 
honey from the supers, the bottles of honey and the wax, in addition to doing a little research on the site. One of the research 
tasks for students could be to investigate where the bees gather their nectar. For this task the teacher would define survey areas 
by loops and have the students survey the bee activity within each area. These survey areas would include a variety of flower 
populations and the students would tally the number of bees moving in and out of the area as part of the survey. This task 
requires students to be able to tally information. The prerequisite instruction on this could include a picture of an area they will 
see on the field trip, with bees. The students count the bees in the picture and make a tally mark for each bee seen. While the 
concept to be generalized is taught using many different examples including an example from an upcoming field trip makes the 
task on the trip familiar when the students are asked to do it. 

At a primary level most of what we want the students to do is work on gathering broad-based awareness of the experience. 
On the trip students could take pictures of what they see to help recall the experience and set it in their knowledge base. While 
developing a formal database may not be conducive to every field trip topic and age range. Children could take pictures of all the 
types of flowers they see the bees on and use the survey data begin to sort by the number of times a bee went to each type flower. 
This would provide a knowledge base from which to discuss how different types of honey are formed, i.e., orange blossom, 
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clover, and blackberry. Pictures of anything unusual that a child or teacher saw could be taken, the children can discuss the trip 
and determined more questions to ask on a follow-up visit by the bee keeper to the classroom. The teacher and the beekeeper 
could take additional pictures that may help answer theses questions after the students made the trip. 



Middle Grades 

In middle grades science, students study the knowledge base of the interdependence of the separate populations in a specific 
habitat. In mathematics, they use numbers to quantify trends and predict the future. An overview of the biological habitat of a 
coastal island provides the students with a chance to study the effects of the different types of land forms and their plant life (the 
beach, primary dunes, inter dune meadows, secondary dunes, the maritime forest and the marshes). The use of pre-trip visuals 
encourages the students when on the trip to focus in on more detail and specific variations then a first time viewing would allow. 
A student who knows what to look for will begin finding instances of the concept immediately. The teacher on this trip would 
want the students to not only note the different zones and their habitat but to also pick a specific aspect to study, such as the plant 
or animal populations. On the beach, one of the task groups may be assigned to study ghost shrimp populations. Photographs of 
the area of the beach where ghost shrimp are located, an active ghost shrimp hole, and illustrations of appropriate survey 
techniques prepare the students to be able to begin the study upon reaching the beach without the need for the teacher to explain 
the task. A group assigned the task of studying live mollusks on the beach, that has the prerequisite knowledge of identifying the 
footprint of a mollusk, the track the animal leaves and what the animal looks like, can begin to locate live mollusks immediately. 
Unfortunately, at any one visit there is no guarantee that specific shelled animals will be present but from study before the trip 
using pictures, the students have trained their eye so they know what to look for and can transfer this knowledge to the animals 
present. On a trip, pictures of biological specimens of plants, shells, animals, birds, and insects could be taken and then looked 
up in the field guides back in the classroom. Using a field guide with the images after the trip will encourage the students to 
focus on the details of the specimen and spend time gathering more information on the trip. Using the guides they can note 
likeness and differences in specific specimens within and across species. 

Databases could be developed of such things as bird sighting, shell types, crab sighting, etc. A database for a population 
such as birds gives students the chance to identify patterns in size of populations, time of day the birds are seen, behavior, and 
migratory patterns. The information in the database could be increased by the class or individual class members who might 
return to the site of the field trip over the year or by using data from previous class trips. Looking at other pictures in the 
database would lead to a discussion of the range of the bird. For instances, if a middle grades class kept the database beyond the 
field trip, students could record sightings of herons in many different settings and add it to the database. Sightings included in the 
database could be from the Atlantic Coast, Pacific Coast, Great Lakes, inland waterways, and marshes. A group looking at live 
seashells, when doing a population study, can bring back information showing the a footprint of a buried mollusk, the track 
leading to the animal, the uncovered animal to verify the type. The group could then take pictures to document the aspects being 
studied of the animal (if the survey addresses size, a picture with a measuring tool would provide evidence, without having to 
remove) before reburying. The images provide data in instances where it is undesirable to remove specimens due to 
environmental restrictions, possible hazards of handling an unknown specimen, or violating state or federal law. 



Secondary 

At this level, much of what we do is only successful to the degree the student sees how it is going to help them “in life”. 
Chances to make connections between the classroom and the world the student will be entering are always needed. In the 
geometry classroom, the use of the shapes and formulas in construction could be made apparent to the students. A field trip to a 
city will provide examples of the role geometry plays in the design and construction of a city. Images of different building and 
their functions would provide the “eye” necessary to view the actual buildings. A general presentation of buildings with 
accompanying architectural drawings, showing the relationship of the design to the finished product provides an overview of the 
trip. For example, showing an image of a finished hotel / motel constructed of individual modules which were built off site and 
imported into the construction site as prefabricated units could be used to illustrate how geometry is necessary to determine the 
relationships and measurements of each unit. Students on the trip could then look for current examples of this type of 
construction. Students given the task of looking for buildings showing examples of the architect’s use of golden rectangles, 
would be shown an example from an image of a building with this feature and would then search the city for further examples. 
Other mathematical principles that can be illustrated include the parallel postulate, instances of geometric solids, and use of 
similar triangles to determine height. When on the trip, documenting geometric application is done by taking pictures of a variety 
of buildings to provide a wide range of shapes used. Images would replace sketches and written notes. These images would then 
be imported into a draw program for future instruction. Pictures imported into a draw program can be analyzed to complete the 
given task. This could be done by manipulating and studying the characteristics of the shapes, using a grid superimposed on an 
image to develop formulas for geometric aspects of the building, or to show elements of projective geometry by drawing 
vanishing points. A database on buildings could be developed and might include the function of the building, the dimensions 
(including square footage of floor space & cubic volume of usable space) image of buildings and image of the building’s 
environment to show esthetic qualities. 
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Teachers: Using Digital Images After the Field Trip 

The images also have uses that are not included in the planning of the trip. The images could be used to enhance future 
instruction, evaluate the objectives related to the field trip, and provide documentation of the quality of instruction provided by 
the trip. 

Teachers can build a collection of the digital images taken on the field trip for use in follow-up activities either identified in 
the planning stage, when questions that were not planned occur or at a later date if questions that relate back to the experience 
arise. Images from several field trips could be combined to compile a resource file for use with future classes. On field trips 
often times unique things occur that the teacher may want to preserve for use in future classroom presentations. A bee keeper 
may be requeening or medicating a hive; a bird or shell might be on the beach that is unusual or not in season during the field 
trip; or a building under construction would offer an opportunity for taking pictures to compare later with the finished product. 

Images from the trip can be used when developing evaluation instruments of the content delineated by the curricular goals 
and objectives for which the field trip provided instruction. At the primary level a child could demonstrate their oral skills by 
giving show and tell reports of pictures taken on the field trip. At the middle grades and secondary level test questions could 
present a visual image and ask the students to identify or discuss the situation (e.g., include the identification and the use of plants 
for medical use, both historically and presently). Demonstration of the student’s ability to use research tools could be 
documented by presenting the student with a picture of a plant or animal and have them use the appropriate field guide to identify 
the specimen and its characteristics. For instance, birds in flight are often shown in silhouette in the field guide. This is very 
hard for the neophyte to see and remember in the field. Looking at a picture they can begin to compare what they saw with what 
is shown. Teachers can have students include images in papers and reports of investigations that will be used in portfolios and 
other authentic assessment situations of the student. Images collected from all trips could also provide excellent documentation 
of the quality of instruction the teacher is providing and could be included in a portfolio of their own work when needed. 

The teacher could construct a virtual reality (VR) field trip to be used as part of the advanced organizer to prepare students, 
to be used after the trip to debrief the student, and discussion what was and was not seen. A VR field trip could provided 
students who missed the trip an opportunity to participate in the planned experience. In addition it could be used to allow the 
parent to see what the students will experience. 

We have presented ideas from only three examples of field trips. As teachers use and become familiar with the camera they 
will find that using the digital camera frees them from the worries and expense of film based pictures, the time consumption of 
processing images, and expands their ability to manipulate the pictures and insert them into classroom presentations. 
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Abstract: National standards in science education argue that science learning should be 
interdisciplinary, inquiry-based, and involve students in real-world projects. Most rhetoric 
in science education also argues for technology integration in science instruction. This 
paper describes the RiverWatch project, which integrates science and technology, and 
models scientific collaboration between 5 th grade students in Indiana and preservice 
teachers at the Pennsylvania State University in Harrisburg. 



Introduction 

I am pessimistic about the human race because it is too ingenious for its own good. Our 
approach to nature is to beat it into submission. We would stand a better chance of survival 
if we accommodated ourselves to this planet and viewed it appreciatively instead of 
skeptically and dictatorially. E.B. White in (Carson 1962). 

One aspect of science education that is often minimized in schools is a history of science itself. In thinking 
about this article and my students’ work in science education, I was drawn back to one of the classic works in 
science research and writing: Rachel Carson’s Silent Spring (Carson 1962). Carson’s purpose for writing 
Silent Spring was to inform America of the dangers of DDT and other toxic herbicides and pesticides to the 
environment, wildlife and its habitat, and to humans. As I revisited this classic case, I was struck both with 
the courage of the author (writing in the face of massive opposition from the chemical industry) and the 
clarity with which it foreshadowed environmental issues that still frame the national discourse. Indeed, Silent 
Spring became a manifesto for the environmental movement that began in earnest in the 1970’s. 

Silent Spring was pessimistic about then current practices of society and the effects of these practices 
on the global ecosphere. The book began with a fable about a fictional town that became poisoned by 
pesticides due to the indifference of its citizens. In the fable, songbirds and fish disappeared from the 
landscape. Livestock sickened and died, and life itself became endangered. Carson ended the fable by 
stating: 



This town does not actually exist, but it might easily have a thousand counterparts in 
America or elsewhere in the world. I know of no community that has experienced all the 
misfortunes I describe. Yet every one of these disasters has actually happened somewhere, 
and many real communities have already suffered a substantial number of them. A grim 
specter has crept upon us almost unnoticed, and this imagined tragedy may easily become a 
stark reality we all shall know (Carson 1962, p. 3). 

Given today’s debate about genetically engineered food, irradiated fruit, and organic farming 
practices, Carson’s story is still poignant today. As I re-read Carson, I began thinking deeply about how 
educators today could teach children about the environment and ecology, thereby helping them become 
scientifically literate citizens. This paper focuses on one pedagogical approach to effecting environmental 
and technological knowledge in today’s youth. 

The purpose of this paper is threefold. First, the paper will describe a long-term project that utilizes 
information technology and promotes hands-on, minds-on learning in Environment and Ecology (E & E). 
Next, the paper will describe the integration of environmental science and information technology in the 
RiverWatch project. Finally, the paper will discuss implications for Pennsylvania’s preservice teachers as 
they prepare themselves to meet the new requirements in Environment and Ecology. 
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Rationale 



Two-thirds of Americans report that they either know “a lot” or “a fair amount” about the environment 
(NEETF 1998). However, when specifically tested on their environmental knowledge, many Americans 
reveal they possess misinformation and misconceptions (NEETF 1998). For example, when asked to explain 
the “goal of paper recycling programs,” 63% of respondents gave incorrect responses. The average score on 
the NEETF/Roper Survey is 2.2 out of 10. Thus, America’s report card on environmental knowledge is not 
good (NEETF 1998). 

To compare the national cross-section of survey respondents to my elementary preservice teachers, I 
administered the 10-question NEETF/Roper Survey as a methods course pretest. Although this represents a 
small sample (N = 49), the average score of 6.5 out of ten indicates that even university students with college- 
level science courses on their transcripts still need substantial content knowledge preparation in E & E so that 
they will effectively integrate E & E as a core elementary subject. 

The new millennium will see continued emphasis in science education and technology integration in 
Pennsylvania’s schools. Joining the current standards-driven K-12 curricula is a new player in the core 
curriculum: Environment & Ecology (E & E). All elementary children are required to have E & E in their 
official curriculum every year. To help K-12 teachers frame their instruction in E & E, the state legislature 
has approved comprehensive academic standards for E & E. 

A 1997 statewide assessment in E & E found that professional development and preservice teacher 
education in E & E “to be among the greatest E & E needs in the Commonwealth” (Johnson and Hoy 1 998, p. 
4). Currently, no colleges of education in Pennsylvania require preservice teacher preparation in E & E. This 
finding highlights an interesting paradox: K-12 students are responsible for rigorous core knowledge in E & 
E, but their future teachers have little content or pedagogical content knowledge in this field. In addressing 
this paradox, the Pennsylvania Department of Education is drafting three proposals, which will directly 
impact preservice teacher preparation in Pennsylvania: 

1) E & E will soon be included in teacher preparation requirements; 

2) E & E academic standards for K-12 students have been approved; and 

3) A statewide assessment test is being developed that will assess students’ knowledge in E & E, science, 
and technology. 

These new standards and requirements in E & E seem to be in line with current research that 
suggests using the environment as “a framework for interdisciplinary, collaborative, student-centered, hands- 
on, and engaged learning” (Lieberman and Houdy 1998, p. 1). In Closing the Achievement Gap , Lieberman 
and Houdy (1998) assert the following educational benefits of using the environment as an “integrating 
context” (p. 1) for learning: 

•better performance on standardized measures of academic achievement in reading, writing, math, science, 
and social studies; 

•increased engagement and enthusiasm for learning; and 

•greater pride and ownership in accomplishments (Lieberman and Houdy 1998). 

In Technology and the New Professional Teacher: Preparing for the 21 st Century (NCATE 1997), 
the National Council for the Accreditation of Teacher Education describes the impact of technology on 
teaching, provides case studies of exemplary technology integration in school curricula, and frames new 
requirements for teacher preparation institutions. NCATE (1997) asserts that “the new technology will 
transform the role of the teachers as thoroughly as did the introduction of printed textbooks” (p. 5). Thus, 
there exists a confluence of science and technology that will provide a major challenge to inservice and 
preservice teachers as the new millennium dawns. 



Hoosier RiverWatch is a state-sponsored water quality monitoring initiative that involves schools, clubs, and 
citizens in collecting water quality data. RiverWatch has three major goals: 

•to encourage local action to improve watershed management; 

•to encourage volunteers to prevent pollution and cleanup streams; and 



The RiverWatch Project 




•to provide data to state agencies so they can improve planning for streams and watersheds (DNR 1997). 

The RiverWatch project began in 1997 with a partnership between the author and his elementary 
science education students at DePauw University, Greencastle, Indiana, and a local fifth grade teacher, Ms. 
Eve Startk. The project focused on a water-monitoring project on the Little Walnut Creek, which is just 
outside of Greencastle. Through a series of field trips, 5* grade students worked with DePauw students to 
establish baseline data on the water quality and riparian forest buffer of the Little Walnut. This long-term, 
inquiry-based, collaborative project was a good representation of the goals for engaged science teaching and 
learning asserted in the National Science Education Standards (NRC 1996). Research questions that framed 
this project include the following: 

•how ecologically healthy is the Little Walnut Creek? 

•how might the creek’s health change over time? 

•what factors affect the creek’s health? 

•do physical, chemical, and biological indicators change over time? 

•what can we learn about the Little Walnut Creek watershed? 

Through the 1997 and 1998 school years, Ms. Stark’s students implemented RiverWatch using the 
“trend monitoring” technique. Using this technique, students performed tests on a regular basis, over a long 
period of time. This technique provides a broad view of a stream’s health and teaches students to distinguish 
seasonal variations from long-term changes (DNR 1997). Trend analysis data included the following 
parameters used to monitor water quality: 

Habitat Chemical Biological 

watershed land use dissolved oxygen benthic macroinvertebrates 

stream bank, channel, flow nitrate nitrogen 

riparian zone total phosphate 

biochemical oxygen demand 
pH 

turbidity 

temperature 

In the second year of the project, 5 th grade students submitted their data electronically via a 
worldwide stream quality database called RiverBank. This allowed students to share their research with other 
students across the country, and analyze stream data from various U.S. watersheds. 

In the 1999 school year, Ms. Stark continued the RiverWatch Project but the author had assumed a 
new position at the Pennsylvania State University in Harrisburg. In Fall 1999, elementary science methods 
students at Penn State Harrisburg began trend monitoring on the Swatara Creek, which is part of the 
Susquehanna River watershed. Penn State students and Ms. Stark’s students shared their research results 
throughout the semester. 



Interdisciplinary Science 

Ms. Stark’s elementary students focused primarily on trend monitoring on the Little Walnut, and enriched 
their science study through children’s literature selections, and by participating in an Internet-based project 
called Rivers of Life, a virtual trip down the Mississippi River during flood season. In this project, students 
learned about land use, ecology, and watersheds. Interdisciplinary activities included data collection, 
analysis, and graphing, utilizing information technology, poetry writing, and looking at how archeology 
uncovers the history of a river. Students’ poetry and trend monitoring data were also published in a state 
journal, The Riparian (Indiana Rivers and Streams Project & Water Watchers of Indiana 1999). 

Penn State students implemented trend monitoring on the Swatara Creek, but also focused on other 
environmental issues discussed in the Report of the Pennsylvania 21 st Century Environment Commission. 
Issues outlined in this report provided an interdisciplinary view of E & E and included: 

• land use; 

•conservation of natural resources; 

•water quality in a healthy environment; and 

•air quality, waste, and efficient energy use (21 st Century Environment Commission 1998). 



Penn State students’ trend monitoring focused on habitat, chemical, and biological parameters. In 
cooperation with experts from the Chesapeake Bay Foundation, students also focused on collecting data on 
the Swatara Creek riparian forest buffer zone. Parameters of this study included: 

•water quality; 

•streambank stabilization; 

•habitat provided in the buffer zone; and 
•aquatic habitat. 



Technology Integration 



The moment man first picked up a stone or a branch to use as a tool, he altered irrevocably 
the balance between him and his environment.... While the number of these tools remained 
small, their effect took a long time to spread and to cause change. But as they increased, so 
did their effects: the more the tools, the faster the rate of change. James Burke in (Gates 
1999. p. 63). 

Information technology was used as the primary tool for collaboration between Ms. Stark’s class and the 
Penn State students. Ms. Stark has developed a classroom web page and an extensive PowerPoint 
presentation that have both been used in conference presentations. 

During the Fall 1999 semester, Penn State students shared their trend monitoring results with Ms. 
Stark’s class via two mediums: email and digital photographs. Penn State students conducted field tests once 
per week, compiled and analyzed results using Microsoft Excel, and emailed their results and digital 
photographs to Ms. Stark’s students. Ms. Stark’s students maintained a continuous dialogue via email and 
asked pertinent questions about the analysis process. A sample email exchange follows: 

5 th Grade Students: We are giving you our update on RiverWatch. It was quite a day at the 
river. We were surprised at some of our results at the site. The benthic macro in vertebrates 
was really low with a only a total taxa rating of 9. We found what we think are some rat- 
tailed maggots which are tolerant to pollution, and one aquatic worm which is also tolerant 
to pollution. One thing that we were all concerned about was the water quality based on the 
benthic macros which was poor. Otherwise we had some better results in the chemical tests 
from the lab. We did have a higher total phosphate than normal. We are seeing different 
results because it has been so dry here and the level of the river is very low. It was only 
70cm deep compared to 120cm that we usually have. We are interested in what you found 
at your river. Send pictures too. 

Penn State Students: Your taxa count was really low compared to last season’s numbers. 

You mention an interesting point about the very low water level, which we also noticed 
from the digital images. Frankly, we were shocked at the low water level of the Little 
Walnut. How would lowering water levels potentially contribute to increased levels of 
pollution and therefore the presence of pollution tolerant species like the rat-tailed maggot 
and worms? Today in class we are going to do our taxa count and graph the bottom profile 
of the Swatara. To give you some idea of the water depth, etc. the stream was 53 meters 
wide yesterday, and about 51.5 meters wide today. Please stay in touch as your research 
progresses. 

The email exchanges between the preservice teachers and the 5 th graders proved profitable on several 
occasions. For example, when Penn State students were puzzled by their chemical results, they emailed the 
results to the 5 th graders. The email reply suggested that the test tubes used to collect the water samples might 
have been dirty and the recommendation was to clean the test tubes and repeat the tests. This proved to be 
good advice and illustrated the power of telecommunications in science collaboration. 

The next stage of technology integration scheduled for the Spring 2000 semester is to implement 
scientific collaboration via Quick Cam technology. This will allow real-time video communications between 
classes via the Internet. 
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Conclusion and Implications 

As the literature review indicated, inquiry-based science instruction combined with technology integration are 
mandated by current standards in science, technology, and E & E. Preservice teachers should be involved in 
projects that integrate these disciplines and model scientific inquiry. The collaborative RiverWatch project 
has enabled fifth grade students in Indiana and preservice elementary teachers at Pennsylvania State 
University in Harrisburg to gain experience in this interdisciplinary, technology-based learning. 

Because trend monitoring is a long-term process, Penn State Harrisburg students will continue to 
participate in RiverWatch and expand its partnership to include several schools in central Pennsylvania. As 
technologies continue to emerge, they will be integrated as necessary into RiverWatch so that more data on 
technology integration in inquiry-based science can be collected, analyzed, and shared with the education and 
research communities. 
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Abstract: The study reported on in this paper investigates the effects of different presentation 
formats on learning an important principle in classical mechanics (the principle of equivalence). 
The presentation formats were abstract (classical vector representation), analogue (a more 
experience based illustration) and animated analogue. The study was conducted (N = 55) at the 
department of physics, Stockholm University. 

Analyses indicate that animations do not facilitate learning in this case. An interesting 
observation is that the analogue and animated groups performed better than the abstract group on 
the analogue problems. But the abstract group did not outperform the other groups on the abstract 
problems. A tentative interpretation is that it is easier to move from an analogue representation to 
an abstract than vice versa. Another interpretation is that it may be the case that the students in the 
concrete conditions expended more effort into applying an abstract thinking on their concrete 
memory image. 



Introduction 

When arguing for the use of multimedia in educational settings the usual argumentation follows the “more is 
more” path (Scaife & Rogers, 1996), that is: a picture is better than (a thousand) words, an animation is better than a 
still, sound is better than silence, etc. However there is not much empirically founded work to support that line of 
arguing. In this study we try to address some of the questions regarding the effectiveness, in regard to learning 
outcome, of different multimedia presentational formats in the domain of Physics. 



Theories of cognition and learning 

The cognitive theories that are of interest in this study are of two different categories; theories about learning in 
general and theories about the interplay of different presentational formats. 

There is an ongoing debate within cognitive science between what could be called the situated camp (e.g. (Lave 
& Wenger, 1991)) and the traditionalist camp (e.g. (Andersson, 1 995)). The issues discussed are very interesting and 
have direct impact on the design of learning material. However important and interesting this debate is, we believe 
that the results of this study could be applicable in both camps (Waern, Dahlqvist, & Ramberg, 2000). 

When creating instructional material you have to be aware of what your goal is. Understanding, remembering, or 
applying are three different outcomes. A strategy that facilitates learning in one of these outcome classes need not 
facilitate learning in the others (Levin, 1989). Ohlsson (1996) makes a distinction between skill acquisition and 
higher-order learning. In skill acquisition the outcome is competence. The outcome of higher-order learning, on the 
other hand, is understanding. Skill acquisition has throughout the short history of cognitive science been quite 
successful. There are models like ACT-R and SOAR which are both theoretically powerful and empirically founded 
(Reimann & Spada, 1996). Research about higher-order learning, on the other hand, is still in its infancy (Ohlsson, 
1996). What we aim at in this study is what Levin would call understanding and what Ohlsson might prefer to call 
higher-order learning. 

It is fairly well established that visual instruction aids are very powerful means for enhancing learning (Waern, 
1995). However, since human attention and perception is limited, different presentational formats can interfere with 
each other (Andersson, 1995). Paivio has put forth a theory about the processing of information in the mind, the 
Dual-Coding theory. In this theory he claims that the human mind has two distinct (but inter-connected) systems, 
one to process language and another for the rest of the information (Paivio, 1986). These theoretical arguments 



promote the use of multiple presentational formats in instructional material. This claim is also founded on some 
empirical findings. Mousavi, Low, and Sweller (1995) for instance, claim to have increased learning of geometry 
problems by mixing auditory and visual presentation modes. 



Presentational Formats 

When constructing instructional material, whether it concerns books, videocourses, or educational software, 
there are many different ways to present the learning material. The choice of media puts different restrictions on 
which presentational formats are possible. For example, it is not possible to use sound in an ordinary book. But there 
are still many choices to be made: text or picture, diagram or images, etc. 

Illustrations 

The use of pictures in prose has been thoroughly studied by many research programs (for a longer summary see 
(Willows & Houghton, 1987) or (Mandl & Levin, 1989)) and it is quite clear that, used with some common sense, 
pictures facilitate learning from text. Pictures in themselves can have different functions. Levin (1989) has classified 
pictures in prose learning according to five different functions: Decoration, Representation, Organization, 
Interpretation and Transformation. There is no uniform theory or even design principle that states how to use 
pictures in all learning situations. It is very much dependent on the task. The saying that "a picture is worth more 
than a thousand words" is not always true (Winn, 1987). Levin (1989) joins the cautious choir and states: "Two 
things that we have learned from research on pictures in text are that pictures are not uniformly effective in all 
prose-learning situations, and that not all types of pictures are equally effective." (p. 97) 

Animations 

In many computer-based instructional products animations have become popular. Unfortunately, the animations 
are often used to impress rather than to teach (Rieber, 1990a). There is a lack of theoretical foundation for the use of 
animations in computer-based instruction. Animated graphics represent a subset of instructional graphics but to 
which extent animations depart from and coincide with static visuals is questioned (Rieber, 1990a) 

In contrast to static graphics, animated graphics can show information about two important visual attributes: 
motion and trajectory. Animations can provide information about an object’s motion, if it is moving, if the motion is 
changing, and how it is moving (path, patterns, etc.). They can also show information about which way the object is 
moving (Rieber, 1996). 

There has not been very much research done on how, if at all, animations can facilitate learning. However there 
are some studies (ChanLin & Chan, 1996; Mayer & Anderson, 1992; Mayton, 1991; Poohkay & Szabo, 1995; 
Rieber, 1990b; Rieber, Boyce, & Assah, 1989). The problem is that the results are inconsistent. Rieber (Rieber, 
1990b) shows that animations facilitate learning for children (under certain conditions) but not for adults (Rieber et 
al., 1989). On the other hand there is for example the study by Mayton (1991) which suggests that the use of 
animations in computer-based tutorials can be beneficial for adults. 

Even though the results from the research on animations in instructional material are mixed to some degree, the 
use of animations in computer-based instruction still appears to have significant potential (Milheim, 1993). Palmiter 
and Elkerton (1993) found in a study that in a condition of text only, users spent less time learning a different, but 
similar, task than did the users furnished with animations. Milheim has put together a set of guidelines (Milheim, 
1993) on how to design and use animations in instructional material. Some of these guidelines are: 

• Develop simpler animations rather than complicated ones. In general, the animated graphic should be 
sufficiently complex to convey the important information within it, yet simple enough to be easily understood. 

• Use animations when the instruction includes the use of motion or trajectory. In terms of motion animation can 
clearly show specific characteristics of an object while it is moving, e.g. its trajectory. 

• Avoid overuse of animation since it can be distracting to learners. 

The animations used in the instructional material in this study has been designed with these guidelines as a point 
of departure. 
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Method 



A study was conducted at the department of physics at Stockholm University. It tested if there where differences 
in the learning outcome regarding the principle of equivalence when provided with different kinds of illustrations. 
This principal within Newtonian physics concerns acceleration and was regarded as suitable for animating according 
to Rieber's (1996) notion of what information animations can provide further than still illustrations. 55 first year 
students counted as subjects. The study was conducted in two phases, with 35 subjects taking part in the first phase 
and the remaining 20 subject participating the next year (same course and same education). The principle of 
equivalence was part of the curriculum for the course they attended during the period of the study. The study was 
conducted before the principle of equivalence was treated in the course. All the subjects participated in the study 
voluntarily. 

Design and Procedure 

To perform the study a small CBI ‘-program was constructed. This program tried to teach the students one 
important principle in classical mechanics: the principle of equivalence. A test was also administered in the program 
in order to test if the subjects had learned something from the initial instruction phase. The study was conducted in 
groups of 3 to 10 subjects at a time. On entering the room where the study took place the subjects randomly picked a 
computer with one version of the CBI-program already started. There were 10 computers in the room, and each 
session therefore consisted of a maximum of 10 participants. During the time the subjects ran the CBI-program the 
supervisor was always present in the room. The supervisor answered questions regarding the use of the program, 
when there were misconceptions due to language difficulties (some of the subjects did not have Swedish as their 
native language), or other non physical science related questions. When seated, the subjects followed the on screen 
instructions. After the subjects were finished they just left the room, and the supervisor collected the data that had 
been saved in a text file. 



Material 

Illustrations 

The illustrations were of three different kinds: abstract, analogue and animated analogue. Abstract here means a 
classical illustration with arrows representing vectors which represent forces (gravitation and inertia) (see Figure 1). 
This illustration was constructed for another study (Ramberg, 1996) relating to the same area in physics. 




A 




Figure 2: The analogue illustration. 



The analogue illustration is a more everyday experience based type of illustration which the student can relate to, 
in this case a railroad cart seen from the inside, with a helium balloon attached to the floor and a steel ball hanging 
from the ceiling (see Figure 2). 

The animated analogue illustration consists of the same setting as the analogue with the exception that 
movement is added. In the animation, the sequence proceeds from: the railroad cart standing still, accelerating, 
travelling at constant speed, applying its breaks until it comes to a halt. The sequence is then repeated. 
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1 Computer Based Instruction. 



The CBI-Program 

The program consisted of four phases: an introduction, a learning phase, a test phase, and a debriefing phase. 

The introduction consisted of a text that explains some practical details about the program. The introduction also 
contained three background questions regarding the subjects gender, age, and previous knowledge of the principle of 
equivalence. 

The learning phase consisted of a text and one of the illustrations described above. The text was divided in four 
parts containing increasingly more detailed explanations of the principle of equivalence. When the subjects were 
finished (with the learning phase, before the test phase) they were asked to estimate (on a scale ranging from 1-10) 
how much they felt they had understood and how much they felt they had learned. 

The test phase consisted of three different types of problems: 

1. In one problem the subjecfs task was to predict what would happen to grass growing on a record player (the 
old-fashioned kind with a turntable). This problem was varied so that in one problem the scenario consisted in a 
rotating turntable whereas in another, the turntable was not rotating. Hereafter referred to as question number 1 
and 2, or the grass questions. 

2. Another problem consisted in the subjects filling in the missing parameters in one abstract-type illustration 
given that a particle is accelerating to the left or to the right. Hereafter referred to as question number 3 and 4, or 
the abstract questions. 

3. In the third problem the subjects were to predict what would happen to the balloon in the railroad cart given that 
the railroad cart is accelerating, keeping an even pace, or applying its breaks. Hereafter referred to as question 
number 5, 6 and 7, or the analogue questions. 

All the questions were multiple choice questions. After having answered the questions the subjects were asked to 
motivate their choice, i.e. give an explanation in plain Swedish (or English). After each question the subjects were 
asked to estimate (on a scale from 1-10) how difficult they experienced the problem to be, and also, how confident 
they were that they had answered it correctly. 

In the debriefing phase the subjects were asked how much they felt they had understood and learned. There were 
also some questions regarding the use of the program itself. 

There were three different versions of the program corresponding to the three different types of illustration. 
Within the three different versions there were two different orderings of the test questions (called 1 & 2), summing 
up to six different versions. The variation in presentation order was performed to eliminate any effects of 
presentation order. In both versions the two questions about the grass on the record player (see above) came first. In 
the version called 1 the two questions about the missing parameters followed, and after that the three questions about 
the balloon in the railroad cart. In version 2 it was the other way around. 



Results 

The participants’ answers were grouped according to which kind of illustration they received during the learning 
phase. These groups are hereafter called: abstract, analogue, and animated. In all there were 55 participants resulting 
in 1 9 in the abstract group and 1 8 in both of the analogue and animated group. 

Quantitative Results 

The answers were counted as correct when totally correct. In questions 3 and 4 there had to be four correct 
statements to count as a correct answer (the correct picture and three correct parameters). On questions 1 and 2 there 
were almost identical results in all the groups. There was almost the same number of correct answers (Table 1 ) and 
the mean values of the estimations, on how certain they were of the answer and how hard the question was 
experienced to be, were very close to each other. 



Groups \ Question^ 


Rotating turntable (#1) 


Turntable not rotating (#2) 


Abstract (19) 


6 


16 


Analogue (18) 


8 


17 


Animated (18) 


6 


17 



Table 1: The number of right answers on the grass questions (1 & 2) (The total number of subjects in each group within 
parenthesis.) 
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Concerning the abstract questions (number 3 & 4) there was a drop in performance in the animated group 
compared to the other two groups (see Table 2). On the other hand the abstract group were significantly (p<0.05) 
more certain about their answers being correct compared to the other two groups. 



Groups \ Question^ 


Accelerating right (#3) 


Accelerating left (#4) 


Abstract (19) 


4 


4 


Analogue (18) 


5 


3 


Animated (18) 


1 


1 



Table 2: The number of right answers for the abstract questions (3 & 4) (The total number of subjects in each group within 
parenthesis.) 

On questions 5 & 6, the analogue and animated groups were better than the abstract group. The ceiling effect on 
question 7 is obvious (see Table 3). 



Groups \ Question^ 


Accelerating (5) 


Breaking (6) 


Constant Speed (7) 


Abstract (19) 


7 


7 


17 


Analogue (18) 


14 


13 


18 


Animated (18) 


15 


14 


18 



Table 3: The number of right answers for the balloon questions (5, 6 & 7). (The total number of subjects in each group 
within parenthesis.) 

Qualitative Results 

When comparing the answers and the motivations it seems that most of the subjects that answered correctly also 
understood the principle well. There were a few obvious "guessers" but they often made a wrong guess. 

Beside the multiple-choice answers, the subjects were asked to motivate each answer in what we called "Plain 
Swedish". These motivations show some very interesting tendencies. There seems to be a connection between the 
kind of language used and the illustration pro-vided. For a more thorough analysis see (Waern et al., 2000). 



Concluding remarks 

The reason to have the grass questions (1 & 2) was that it would be an unknown presentation format for all the 
groups. If one of the groups would have had a better score on the first question this could be taken as an indication 
that the presentation format of this group made for a better and deeper understanding of the principle of equivalence. 
This did not happen, but this does not say that there are no differences between the presentation formats. More 
research is needed to sort these questions out. 

It is reasonable to assume that the analogue and the animated groups should outperform the abstract group on the 
balloon questions. This because they are more familiar with the presentation of the problem. But following this line 
of reasoning the abstract group should outperform the analogue and animated groups on the abstract questions. This 
did not happen. This could be because the abstract question was too difficult (small amount of correct answers). A 
tentative interpretation is that it is easier to move from an analogue representation to an abstract than vice versa. It 
can be hypothesized that physics students are more used to abstract representations and descriptions and this in turn 
made it easier for the analogue and animated groups to perform well on abstract problems. Another interpretation is 
that it may be the case that the students in the analogue and animated conditions expended more effort into applying 
an abstract thinking on their concrete memory image, whereas the students in the abstract condition had difficulties 
in seeing the concrete application of the principle. 

Subjects were asked to rate the difficulty of the problems and how confident they were in their answers being 
correct. The analogue and animated groups rated their confidence significantly lower on the abstract problems and 
slightly lower on the other problems. One hypotheses is that the analogue group has a deeper understanding of the 
principle but when presented with a presentation of the problem they had never seen before they felt uncertain. This 
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however does not account for the fact that the abstract group did have about the same confidence level on the 
analogue questions (5, 6 & 7). 

A possible reason for the learning difficulties in the abstract groups lies in the fact that the behavior of the 
balloon is counterintuitive. In the explanations to their answers, many students based their reasoning on prior 
experience. Ramberg & Karlgren (1999) found similar effects in another study. 

Throughout the test the animated group did not differ significantly from the analogue group. This is in 
accordance with what Rieber and associates (Rieber et al., 1989) found in their study. 

Based on these results, it seems that animations do not add anything to the learning outcome in physics teaching. 
However the use of illustrations based on everyday scenarios can be beneficial. Instructional designers should also 
work with contradicting the everyday experiences. Concrete examples and illustrations are better in this respect than 
abstract reasoning. 
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Abstract: This paper describes the rationale for the forthcoming Principles and 
Standards for School Mathematics and accompanying electronic pedagogical 
examples. Many of these electronic examples are part of a web-based national library 
of virtual tools and manipulatives being developed at Utah State University with 
support from the National Science Foundation. Also included is a review of research 
on the use of computer-based manipulatives, description of applet design 
considerations and characteristics, and a discussion of research implications. 



The National Council of Teachers of Mathematics (NCTM) recently distributed a discussion draft of a 
set of national standards for school mathematics (NCTM, 1998). This draft built upon the highly regarded 
Curriculum and Evaluation Standards for School Mathematics (NCTM, 1989). The final version of the 
new document, commonly referred to as Standards 2000, is being prepared for publication and will 
available for distribution in April, 2000. 

The NCTM adopted national curriculum standards or guidelines to "ensure quality, indicate goals, and 
promote positive change in mathematics education in grades pre-K - 12” (NCTM, 1998, p. 11). The fact 
that over 40 states have developed mathematics curriculum standards patterned after the NCTM 
Standards, suggests widespread appeal for focused efforts to increase quality of instruction, establish 
specific goals, and promote evaluation and assessment of content and pedagogy. The appeal of the 
mathematics standards is also evidenced by fundamental changes in commercial textbooks and funding 
initiatives at federal and state levels. 

There is also some evidence to suggest that establishment of national curriculum standards, associated 
changes in commercial textbooks, and implementation of federal and state funded reform initiatives, have 
resulted in a noticeable improvement in standardized test scores of mathematics achievement. While 
these suggested correlations need further investigation, it appears that positive change is underway. 

However, the pace of change in mathematics education is slow compared to change in access to 
technology and information. In the introduction to the draft version of Standards 2000, NCTM 
recognizes that, "student access to computers and the World Wide Web is now relatively common, 
whereas in 1989 availability of handheld scientific or graphing calculators was uncommon" (NCTM, 

1998, p.15). 

In conjunction with publication of a printed document, NCTM is developing an electronic version of 
the Standards 2000. This ’e-version' will include on-line examples of mathematical content and 
pedagogical strategies that correspond to the philosophy and goals of the new standards. The e-version 



181 



will "allow a richer array of examples to illuminate and extend the ideas provided in the text and ...make 
possible the inclusion of links to resource and background material" (NCTM, 1998). The current 
electronic version and associated supplemental materials is available at: http://www.nctm.org. 

Certainly, there is enormous potential for professional organizations to utilize web-based technologies 
to make curricular and pedagogical information retrieval and use more efficient. Teachers, constrained 
by increased demands for academic accountability, increasing numbers of students, and pressures to meet 
social, emotional, and academic needs of increasingly diverse groups of students, have limited time to 
seek information and strategies to address the multitude of challenges they encounter. A challenge for 
funding agencies, professional organizations, teacher educators, and educational technologists is to 
promote, design, and test mathematical models and activities that address core mathematics concepts. 

Purpose 

The purpose of this paper is to describe a rationale for development and use of web-based interactive 
applets in school mathematics. In addition, we will illustrate several of the examples being developed for 
the electronic version of Standards 2000. 

The authors are co-principal investigators for a National Science Foundation project to create a web- 
based National Library of Virtual Manipulatives for learning mathematics in the elementary grades (K-8 
emphasis). Many of our virtual manipulatives are based on physical manipulatives commonly in use in 
the schools (i.e. geoboards, tangrams, pattern blocks, fraction bars); others are concept manipulatives 
especially designed to teach or reinforce basic mathematical concepts. Our emphasis is on interactivity 
for the user, so the learner controls the variable aspects of the manipulative and is not only free, but 
encouraged, to explore and discover important mathematical principles and relationships. Teachers or 
parents can provide direction, but control of the activity remains with the user. 

We are now working very closely with the Electronic Format Group and the writers of the new 
Principles and Standards to provide appropriate E-examples for all four grade- bands. The majority of 
electronic examples that will appear with the web version of the Standards, to be released at the annual 
national meeting of NCTM in April of 2000, will be our interactive applets. 

Rationale 

The rationale for development of web-based instructional technologies is two-fold. First, the web has 
the potential to provide users with easy access to information about curriculum, research, needs 
assessment instruments, instructional strategies, supplemental resources, assessment tools, diagnosis and 
remediation strategies, and instructional models (or manipulatives) and tools. Traditionally, access to 
educationally sound curriculum and associated physical manipulatives and tools has been limited to 
school experiences. Even then, expensive supplemental materials are often not available in schools. Web- 
based, interactive manipulatives and tools are freely available at any time. The challenge is to provide 
easy access to materials that are intuitive 

Second, the virtual environment offers potential for substantial enhancements over similar physical 
materials, manipulatives, and tools. Digital enhancements to physical models and tools include: rapid 
upgrades or revisions to existing information, increased interactivity between developers and users, 
unlimited availability of relevant data and related information, capability to enlarge print or enable voice 
activation for handicapped users, and ability of user to change or modify existing information or 
materials to suit their particular needs or creative instincts. 

In subsequent sections, we review the literature on development and utility of electronic 
manipulatives and tools and discuss design and development characteristics of emerging technologies. 

Review of Research 
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The development of web-based virtual manipulatives and tools for school mathematics has the 
potential to realize educational advantages from use of both technology and physical manipulatives. It 
has been suggested that the use of technology for mathematics instruction enhances “mathematical 
thinking, student and teacher discourse, and higher-order thinking by providing the tools for exploration 
and discovery” (Bitter, G. & Hatfield, 1998, p. 39). Specific benefits for using technology include: 

1 . Promotes active versus passive learning. 

2. Offers models or examples of exemplary and non-exemplary instruction. 

3. Is illustrative and interactive. 

4. Facilitates the development of decision-making and problem solving. 

5. Provides user control and multiple pathways for accessing information. 

6. Provides motivation and allows for variability of learning styles. 

7. Facilitates the development of perceptual and interpretational abilities. 

8. Offers efficient management of time for learning and less instructional training time. 

9. Allows for numerous data types. 

10. Offers multilingual presentation (p. 106). 

Justification for the use of physical manipulatives in mathematics instruction includes: making the 
abstract world of mathematics more meaningful, assisting in the transfer of knowledge from learned to 
unlearned situations, improved student motivation, and enabling greater insight into children’s thinking 
(Fennema (1973). Suydam and Higgins (1977), in an extensive review of on the role and use of 
manipulative materials in mathematics also suggest that “lessons involving manipulative materials will 
produce greater mathematical achievement than will lessons in which manipulative materials are not 
used” (p. 91). 

A recent review of research located five dissertation studies and four research articles from 1989-1999 
where computer software was used to simulate or model physical manipulatives. Four studies provided 
evidence to suggest that students who use computer-simulated manipulatives and tools experience higher 
achievement and conceptual understanding in mathematics than those using associated physical 
manipulatives or no manipulatives (Kieran, C. & Hillel, J., 1990; Smith, J., 1995; Thompson, P., 1992). 

In another two studies, use of computer-simulated tools and manipulatives was shown to increase 
conceptual understanding in mathematics when used in combination with physical manipulatives and 
tools (Ball, S., 1988; Terry, M., 1996). 

Comparisons between studies where use of computer-based manipulatives resulted in higher 
achievement, and those that did not, reveals that achievement may be affected by a myriad of design and 
sampling characteristics. For example, computer-simulated Base-10 blocks, two color counters, fraction 
strips, and ruler and protractor were used in the six studies producing positive results. Studies using 
simulated attribute blocks (Kim, 1993), pegboards and color cubes (Berlin, & White, 1986), and 
geometric shapes (Nute, 1997) realized no noticeable increase in student achievement. 

Similarly, treatments from studies that yielded positive change in understanding were administered 
when classroom teachers believed they fit in with the natural flow of the curriculum. Of the studies 
where no increases in achievement were noted, treatments were administered at times that interrupted the 
normal curriculum. Additional variables that may influence computer-based manipulative effectiveness 
include: previous experience with computers, grade level, mathematical topic, treatment length, and 
computer-to-child ratio. 

While research on the use of computer-based mathematical models and tools is mixed, there are some 
findings that provide promise and direction for future design and experimentation. 

Design Philosophy 

Initially, as we contemplated constructing electronic manipulatives that could be used by children, we 
were guided by existing physical manipulatives (See Figure 1). We were confident that we could make 
electronic versions that, because of their residence on the Internet, could be made available to students, 
teachers, and parents, at any time and in any location having a web-connection. 
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One of our first creations was a virtual geoboard, mimicking the common nails in a board version 
using rubber bands. As we shared an early version with teachers, recommended we enable users to color 
the regions inside the rubber bands. Later reviewers wondered if it would be possible to translate an 
elaborate construction around the board without having to shift the band from every vertex. We are now 
working on incorporating both translations and rotations, illustrating the mathematical concepts of slides 
and turns. 

Building such features into a virtual manipulative allows users to do things that are not possible with 
corresponding physical manipulatives. We constructed a circular geoboard, and a third board using nails 
spaced to form an equilateral triangular grid. The circular board has immediate applications as diverse as 
creating pie-chart fractions and illustrating trigonometric functions. 

In the design of all of our virtual manipulatives, we make a conscious effort to avoid doing too much. 
We would rather have five manipulatives, each doing a well-defined task, than a single applet that 
requires more complicated operations to accomplish the same five tasks. Each applet has a tightly 
designed focus and the simplest interface we can create. The mathematics underlying the functionality is 
often very sophisticated; what the user sees and does is very simple (See Figure 2). 

Another principle that guides all of our design is that the student must interact with the applet to 
accomplish something. There is never simply a watch this clever animation or see what happens when 
we do this attitude. Mathematics, perhaps more than any other discipline, cannot be learned by watching 
someone else do it, no matter how elegantly. Any student, to be successful, must be involved and 
engaged in the activity. We believe that thoughtful engagement requires participation. Interactivity is 
thus essential to the design of every one of our applets, the one feature that we absolutely require. 

The kind of interactivity we design requires the user to think about a specific task, to formulate 
strategy to achieve a specific goal (almost always informally, and seldom articulated), to engage in some 
physical action (clicking to select something, dragging an object, or moving a slider), and to observe (and 
perhaps, describe) consequences of the action. The goal is to allow students to control events and to 
discover relationships. Differences between coincidence and causal relationships become clearer when 
we allow the user to repeat an activity as many times as desired. We can ask questions to direct 
explorations and, we hope, guide meaningful discovery, but control remains in the hands of the user. 





Nothing happens until the user takes action, and an activity can be repeated until there is satisfaction; the 




Future Research and Evaluation 

Initial evaluation and research efforts have focused on analysis of instructional design features that 
enable applet users to increase their understanding of mathematics concepts and incorporate applet use in 
their math curriculum. Primary information gathering methods are interviews and observations of 
student and teacher interaction with the applets. In addition, solicitation of formal feedback from writers 
of the Standards 2000 document on activity suitability will be forthcoming. These efforts continue to 
yield valuable anecdotal information that is being used to inform applet design and associated activity 
development. 

In addition, researchers are conducting quantitative investigations on the effects of using Geoboard, 
Tangram, and Pentomino applets on geometric concept acquisition among students in grades six through 
eight. Of particular interest are studies that investigate whether there are differences in knowledge and 
reasoning abilities between students using virtual manipulatives, physical manipulatives and no 
manipulatives. While studies of this nature have potential to inform multiple audiences, there are 
obvious challenges associated with research design and implementation that make generalizations about 
benefits to the use of virtual manipulatives a matter for the future. 
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Abstract: This paper presents web-based tutoring system (W-TCL) for teaching computer 
programming languages through WWW. In this version, two new features have been added: 
blackboard module and adaptive interface. With blackboard module a teacher can exchange 
his expertise with other teachers, and with adaptive interface the novice student will be 
satisfied because the system avoids complex interfaces. The system contains three sub- 
agents: the personal assistant agent for teacher (PAA-T), the personal assistant agent for 
student (PAA-S) and tutoring agent (TA). Using PAA-T, many teachers can cooperate 
together to: (a) put the curriculum of one/more computer programming language(s), (b) add 
or modify the commands' structure that will be taught, (c) generate different tutoring dialogs 
for the same command, and (d) generate different tutoring styles (e.g. text or Q&A). 



Introduction 

Learning one of the computer languages today, is essential for students in both undergraduate and 
graduate levels. However, the lack of good instructors is a problem. Using computer-aided instruction (CAI) 
and Internet technology can solve this problem. 

The movement toward client-server applications began in the late 1980s and so in many organizations 
there are already many server applications with well-structured APIs for RPC or IPC access by a client. 
However, in many cases the backend server is a relatively standard database monitor, which provides no logic or 
protocol specific to the current application. The emergence of network computing, where the client side of the 
application logic is provided by JAVA applets that are downloaded at runtime to a Web browser, offers a new 
opportunity for constructing the agent-equivalent of a Web browser (Alper, 1997). With the WWW as an 
educational platform, it will be feasible for the students to access the multimedia courseware with general- 
purpose browsers. No special tools are required to start learning. For the courseware provider, it is not necessary 
to worry about the distribution and maintenance of the copies of the courseware but they just take care of the 
original on their server (Nakabayashi et al., 1997). 

Lewis Johnson (Lewis Johnson, et al., 1997) support interaction with teachers and students through 
their project ADE, using off-the-shelf whiteboard and teleconferencing tools. But this required both teachers and 
students to be on-line. 

The proposed system consists of three agents representing a server-clients relationship, tutoring agent 
(TA) as a “server”, personal assistant agent for teachers (PAA-T), and personal assistant agent for students 
(PAA-S) as a “clients”. The PAA-S can communicate with TA through WWW to retrieve the tutoring dialog of 
the command(s) that a student wants to practice, and to access the experiences of other students in blackboard 
module. While the PAA-T communicates with TA to add/modify semantic rules of computer programming 
languages and to check the correctness of the contents of the blackboard database (as shown in Figure 1). 



Personal Assistant Agent for Teachers 

The object of the personal assistant agent for teachers (PAA-T) is to standardize the decomposition of 
the language under investigation (as shown in figure 2), such that TA can deal with all languages with the same 
way. Each computer programming language has been stored at a different directory, and each file in its directory 



represents a command name associated with (level of difficulty, text or Q/A or quasi). For example, the file 
named for01t.html at BASIC directory, means that this file contains the text describes the FOR command for 
first level. PAA-T consists of three parts, expertise module, semantic rules base, and tutoring text base. PAA-T 
helps the teacher to cope with the knowledge base of a computer programming language under investigation, to 
add or modify the command’s structure that will be taught, and to produce a meta level language representing 
this computer language, which we call it “semantic rules”. To construct the semantic rules base, PAA-T uses 
BNF (for Backus-Naur Form) (Aho, etc., 1986). 




PAA-S 

Students Agents 



PAA-T Teachers 

Agents 



Figure (1): W-TCL System 



Tutoring Text 

Tutoring text-base contains the text that represents the commands of computer programming 
language. Text is organized in terms of a conceptual network (Brusilovsky, et al., 1996) hierarchically into 
lessons, sections, subsections, and terminal pages. Terminal pages contain the problems to be solved for the 
current command under investigation before it introduces new command. Each teacher can contribute in this 
tutoring text-base: he/she provides an optimal learning path for an assumed average student. The tutoring text 
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will be retrieved by the name of the command. At the database, the extension of the command’s name represents 
the teacher’s ID number as well as the order of this text. The ID number of the teachers and the order of the text 
will be used to determine which text should present first at PAA-S. Taking into consideration the teacher’s 
specialist (since a text of one computer programming language can be used in teaching another computer 
programming language, as we shall later). 







Figure (2) : Teachers decompose computer languages 



Blackboard module 

Teachers can share their experiences through blackboard module. The blackboard module has three 
components: 

> global database called the blackboard (hosted at the TA-Server), 

> independent knowledge sources (from any PAA-T), 

> Scheduler to control knowledge sources and the blackboard database. 

All experience elements are recorded in a structure, global database called the blackboard (Avelino et al., 1993). 
The blackboard structure organizes experience elements along two dimensions, computer language name and 
command name. Each record contains the following fields (teacher ID, computer language, command name, 
new quasi, and suggestion of solution). 

When a teacher wants to generate some examples and he needs some previous examples even from 
different computer programming language, then he sends a message to the message center at the blackboard 
module. A statement of the example required is displayed by the message center to all teachers on line. When a 
participant feels that he can contribute to the solutions, he sends his contribution to the message center. 



Personal Assistant Agent for Students 

The personal assistant agent for students (PAA-S) consists of three components, student model, 
tutoring module and user interface module. 
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Student Model 



PAA-S invokes the student model to check the student answer. In order to accept a free format 
answers from a student, one of the Compiler-phases had been used, it called “Lexical Phase” (Philip et al., 
1978). The lexical phase is concerned with breaking up the string of characters into the words they represent. 
For example, if the system asks the student to construct a conditional statement that calculates the tax as 10% of 
the salary if the salary exceeds 200000 yen, then the answer of one student might be: 

if salary >200000 then tax = salary * 0.1 

The lexical phase would discern the fact that this character string represents the word “IF” followed by variable 
“salary” followed by the operator “>” followed by the number “200000” followed by the word “THEN” 
followed by a statement “tax = salary * 0.1”. Again the last statement will be broken to be variable “tax” 
followed by an equality operator followed by variable “salary” followed by multiply operator followed by 
number “0.1”. 

Each token consists of two parts, a class part and a value part. The class part denotes that the token is 
in one of a finite set of classes and indicates the nature of the information included in the value part. 

Moreover, during lexical phase in the above example, PAA-S makes spell checking for the reserved 
word character by character. For instance, if the student enters “if salary > 200000 tha”, then the agent will not 
accept any other characters and underlines character “a” and an error message appears, guiding the student to 
correct it to be character “e”. Then the student can complete his answer. Note that, if the student enters “tex” 
instate of “tax”, the system will not correct it, since the system checks only reserved words for the computer 
programming language under consideration. The system always consult semantic rules base to do that. 



Using the tutorial module 

When the student accesses the module, the system asks about the computer’s language, which the 
student wants to learn. The system downloads the tutoring dialog of this language and waits for the student to 
select the command he/she wants to practice, to retrieve the associated tutoring dialog’s file(s). The system 
presents the text that describes the command, and asks the student if he/she understands it or not. If the reply is 
“no”, the system presents another text for another teacher. If still the answer is “no” the system converts to 
another style for presenting the command (e.g., Q&A) or consult the blackboard database. If the reply is “yes”, 
the system asks the student to write an example statement to check it. The system can accept a free format text 
from the student, and then infer the student model to check this statement. If the statement is correct, the system 
increments two counters, one for the number of questions which had been asked to the student, and the other is 
the correct answer counter. Otherwise, only the first counter will be increased. If the correct answers of a student 
exceed 75% then the level of difficulty will increase by one, but if it is less than 50% the level of difficulty will 
decrease by one. After the student completes this step, the system re-presents the first menu to allow the student 
to select one of the followings: (a) select another command, (b) present the score, and (c) exit. 



PAA-S & TA interface 

Students can share their experiences through blackboard module. All experience elements are 
recorded in a structure, global database called the blackboard. The blackboard structure organizes experience 
elements along two dimensions, computer language name and command name. Each record contains the 
following fields (student ID, computer language, command name, problem description, and suggestion of 
solution). 

When a student faces a problem, and he/she could not catch the required meaning from the teacher’s 
text, he sends a message to the message center at the blackboard module. A statement of the existing problem is 
displayed by the message center to all students on line. When a participant feels that he can contribute to the 
solutions, he sends his observations and/or conclusions to the message center. 

The scheduler organizes the knowledge source activity as well as the blackboard database and sends 
the content from time to time to teachers to check its correctness, if it is correct it is moved to previous dialog 
database (hosted at TA) (as shown in figure 1). Each teacher observes the messages written by others and 
considers those messages related to his specialty. Some of those teachers (who built the knowledge base for the 
same computer programming language under investigation) are able to offer immediate suggestion on what to 
do since their knowledge applies directly to the information currently in the message center. Others (who built 
the knowledge base for another computer programming languages), however, are forced to wait, possibly for an 
extended time, before their expertise is needed and can be applied. 



PAA-S User Interface 



In most of intelligent learning environments (ILE) systems, only tutoring component is adaptive. The 
user interface usually looks the same for the novice and for the advanced student, while the student’s knowledge 
changes from the beginning to the end of a course (Brusilovsky, et al., 1995). In PAA-S we use the student 
model for creating an adaptive interface. This done in several ways: (1) last state adaptation, (2) visual adaptive 
annotation of links, and (3) function panel adaptation. By this way, the student can feel better, because when the 
interface is oriented towards an experienced student, the interface appears to be too complex for a novice 
student, and vice verse. 

The browser downloads the HTML page and the applet code from TA server to PAA-S. The applet 
then runs on the client’s computer. First, the applet downloads the data file containing the initial variables about 
how the user interface should looks like. Then according to the student performance, which will be recorded in 
the file, the browser downloads the suitable page for him. 



Last state adaptation 

Last state adaptation means adaptation to the last state of the user-system interaction, i.e. the system 
keeps the “settings” of the individual user (working directories, window position, etc.) and comes up when 
starting like the last time the user worked with it. 



Visual adaptive annotation of links 

PAA-S uses an extension of the traffic lights metaphor to annotate links visually. When presenting the 
current command tutoring under investigation, links to the other commands were annotated corresponding to a 
simple traffic lights metaphor referring to knowledge state of each student. A red font of the link indicated that 
the corresponding command or section was not ready to be learned because necessary prerequisites were not 
met. The prerequisite relationships between commands are not represented directly, but the system is able to 
compute them from part-or and is-a relationships using several heuristics. A green font of the link indicated that 
this command or section was ready and recommended to be learned and a yellow font indicated that this 
command have been learned. If the student visit a tutoring part of a command and did not success to solve its 
exercise, the link of this command will be marked as a green font not as a yellow one in the next invoke. 



Tutoring Agent 

TA contains tutoring module, previous dialogs database, semantic rules base, and blackboard 

database. 

Any computer language has command(s) for I/O, condition, loop, and etc. The way to teach those 
commands is almost the same for all computer languages, for instance, to teach the condition command in 
BASIC will be done in quite the same way as the condition command in FORTRAN. The tutoring agent can 
construct the tutoring module for the new language by retrieving the tutoring dialog of similar command in 
another language and adapts it. This is very useful to produce several tutoring texts from different teaching 
point of views to fit students needs. For example, if TA has the tutoring dialog of IF command in BASIC, then 
it consults the semantic rules of FORTRAN to substitute the BASIC command in tutoring dialog with the 
FORTRAN command. 



W-TCL & WWW Interface 

A main design consideration in W-TCL version was to reuse as much of component as possible. In the 
stand-alone version (El-Khouly et al., 1999), students receive immediate feedback on every action they take. If 
they enter an incorrect statement, the system will present a message error and guide them to correct answer. 
HTML forms do not allow this kind of tightly coupled interaction. TA server receives information about student 
actions only when the student submits that information. In W-TCL system, the TA, PAA-T and PAA-S agents 
can find and communicate with each other dynamically, using Common Object Request Broker Architecture 
(CORBA). CORBA allows agents find each other and coordinate their behavior on a common object bus. This 
makes CORBA ideal for component-based applications. The advantages of using such technology in W-TCL 



system is using those objects as a metaphor for using existing stand-alone A-TCL application as well as 
personalizing and task sharing between the client and server. In Internet based W-TCL, the Java ORB is used. 
With a Java ORB, an applet can invoke methods on CORBA objects using the HOP protocol over the Internet. 
Consequently, there is no need to use HTTP and CGI programs that are the cause of extra overhead on the server 
and also the client-side ORB enabled applets can be used in any Java enabled browser. 



Conclusion 

In this paper, W-TCL system had been presented for teaching computer languages. W-TCL consists 
of three agents, tutoring agent, personal assistant agent for teachers and personal assistant agent for students. 
They communicate with each other as client-server through WWW. This allows the system to communicate with 
other agents to exchange semantic rules and tutoring text for different languages. The adaptive learning 
environment had been used in PAA-S. Moreover, both the teachers the students can share their experiences 
through the blackboard modules hosted at TA, i.e. the system can be dynamically enhance by all members 
(teachers & students). 
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Abstract: In this paper college science instruction via the Internet is examined from three perspectives: students' on-line learning 
experiences; a comparative examination of learning on-line versus traditional instruction; and instructors' experiences teaching on-line. 
The setting was a freshman-level human anatomy / physiology course. Three students participated in a collective case study to describe 
the learning environment created by the Internet course. Motivation, computer savvy, and self-confidence were important to their 
success. A quantitative study of the on-line course and the traditional course evaluated the comparative effectiveness of the learning 
environments. Achievement scores and survey results indicated content understanding and retention were not effected, while desirable 
student study habits were used more frequently in the Internet section. To better understand the instructional implications of on-line 
courses, a case study was conducted. Internet instructor's time commitment and level of teaching satisfaction were high. The instructor’s 
role changed, causing some lessening of job satisfaction. 



Introduction 

Higher education is increasingly using advanced technologies, such as the Internet, as a means of 
instruction. The asynchronous nature of advanced technologies is causing a cultural change in instruction. No longer 
is a college education confined to the traditional campus, where students and instructors meet at designated times; 
the dynamic nature of information technology is changing higher education (Connick 1997). Despite these changes, 
the responsibility of the instructor to maintain (and increase) the quality of instruction and create an appropriate 
learning experience remains. (Wagner 1997). The purpose of the research presented in this paper is to better 
understand the implications the Internet is having on higher education. 

Distance education at the collegiate level is no longer novel, but the use of the Internet as a means of 
instruction is a relatively new phenomenon. Several studies have explored the supplemental instructional use of the 
Internet without delving into the effects of that use (Brooks 1997; Chute, Thompson & Hancock 1999). As a partial 
answer to this dearth of knowledge, this research was undertaken to examine Internet teaching effectiveness in a 
college science course. Three studies were conducted and comprise the research reported here. In the first study, on- 
line learning experiences were investigated using a case study approach. The second study was a comparison study 
in which student study habits and achievement in Internet-based instruction were compared with those in traditional 
instruction. In the third study, an investigation of teaching via the Internet was conducted. The intent of this case 
study was to better understand instructional factors of Internet-based instruction by gathering data from professors 
who teach via the Internet. 



The Course 

At Iowa State University, the freshman-level Human Anatomy and Physiology course (Zoology 155) was 
offered via Internet as well as via traditional format, A three-credit course, the traditional format for the Human 
Anatomy and Physiology class is taught in a single-section via lecture to more than 500 students who enroll each 
semester. There are no laboratory exercises associated with this class, although a companion laboratory class may be 
taken during the same semester. Course assessment is based on student performance on three or four exams, one 
comprehensive final exam, and 3 to 7 homework assignments and/or quizzes throughout the term. Typically, the 
class is taken by students from all colleges and majors in the university. It is required for a degree in Psychology and 
Food and Nutrition, and is used to fulfill requirements for coaching certifications and entry into the Veterinary 
Medicine program. Additionally, the course is taken by many students to complete their general science 
requirements prior to graduation. 
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An Internet offering of the same class was prepared in the Summer of 1997. The Internet version follows 
the protocol created through ProjectBIO (an externally funded project to create a protocol for internet-based college 
instruction). This protocol allows instructors to teach college courses entirely on-line. Each course in ProjectBIO, 
including Human Anatomy and Physiology, includes a series of lectures with pages of text and visuals as they 
appear in the traditional lecture. An audio stream accompanies the lectures, following as closely as possible to that 
given during traditional instruction. For the Human Anatomy and Physiology course, all lectures, exams, quizzes 
and homework assignments were created and made available to the student on the first week of the fall 1997 
semester. 



Case Study of Students* On-line Learning Experiences 

To assess the learning environment perceived by the students enrolled in Internet-based science course, a 
case study was conducted. The research was guided by the question: What, specifically, does the student experience 
as he or she works through a semester-long science course taught entirely on-line? 

Three students were chosen as subjects to be followed as they worked their way through the Internet 
offering of Zoology 155. As a basis for choosing these students, demographics on previous Zoology 155 enrollment 
was analyzed. The typical student in the traditional class, averaged over three semesters, was a female of sophomore 
standing with a GPA of 2.7. She was an Iowa native graduating from high school in the 68th percentile and currently 
enrolled in the College of Liberal Arts and Sciences. In choosing the three subjects for this study, one was chosen to 
match the traditional demographics as closely as possible. Her case was referred to as "Judy". A second student, 
"Mitch", was chosen as a representative of the "non-traditional student population" as defined by the University 
handbook. "Sara", the third student, was chosen from the University - defined at-risk population. 

Data collection was carried out using the qualitative methods of interviews, informal chats, open-ended 
telephone conversations, participant journals and e-mail correspondence. These many avenues of data collection 
were employed to reduce the likelihood of misinterpretation, to include redundancy in the findings (Denzin 1989, 
Goetz & LeCompte 1984) and to provide triangulation of findings to ensure validity of the conclusions (Stake 
1994). Additional information was gathered using the standard course assessment tools, including homework and 
exam scores as well as participation points for joining in discussions and chat sessions. 

"Judy" was a native Iowan enrolled as a sophomore in the College of Liberal Arts and Sciences. At the start 
of the semester, she had a GPA of 2.8. She was a Psychology major; thus, Zoology 155 was required for completion 
of her degree. Her goals included becoming a Mental Health Therapist or a Counselor. In her first journal entry, she 
wrote "Today was a disaster! It took me an hour to figure out how to register on ClassNet. Talk about vague 
directions.”. Judy had persistent difficulty with the technology, evident in her e-mail correspondences. "Did I really 
miss all the points or did I do something wrong? Please try to respond. Also, if I messed up when I entered them, is 
there any way I can go in and fix them?". "I tried to see lecture 6 - damn computer wouldn't let me - it's lucky I 
didn't break it! So I moved on to lectures 7, 8, and 9, which it allowed - You figure it out - 1 even tried 6 again later - 
but it still hated me - damn modem technology!!!". In her final course evaluation, Judy noted the class was 
interesting, the content was explained well, and the format was not a deterrent. 

The second student, "Mitch", was selected as a representative of the adult student population. At the time of 
this study he was a 52 year old senior in the Bachelor of Liberal Science program, College of Liberal Arts and 
Sciences hoping to graduate in December. His grade point was high - 3.7 - but he graduated from high school in the 
lower half of his class. Mitch held a full-time job as a policeman, taking classes on nights and weekends to finish his 
degree. Mitch had a positive outlook on life. Each time we met, he was friendly and full of smiles. He is a realist, 
admitting his limitations and also his strengths without hesitation. This was evident in his e-mails: "I am looking 
forward to this course because not only will I find it challenging, but working my way around the web promises to 
prove challenging". Mitch felt that his grade was affected not by the computer technology, but rather by the 
"science technology - I just didn't know enough". During an interview, he emphatically noted that the medium did 
"not at all affect my grade. I could go back and repeat lectures and study before tests. This was a good thing". "This 
is a totally personal experience. I was hesitant at first - motivation? This was the first course where you got down 
and studied.". Although I did not sense his leaning on me as much as other students in the Internet section, Mitch 
admitted to being "quite reliant on the instructor. I re-listened to lectures, sent you lots of mail. I never felt out of 
touch". Mitch did note that motivation was a big factor in passing the class. He expressed concern for the average 
college student. "They can get lost easily. I got lost at first, then caught up. This is a benefit as well. You can get a 
week ahead if you want". 
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Sara, the third participant in the study, was a senior at the time of the class, with a 3.0 GPA. Her grade 
point had dipped slightly in the past semester from a 3.5 due to "senioritis". Sara was a native of Bombay India, and 
spoke both Hindi and English fluently. Sara fell under Iowa State University's "at-risk" student definition due to her 
low high school rank and her nationality. In her first interview she described herself as a "non-exceptional student 
who was on every school team she could". She did enjoy science in high school but did not take it in college. "I was 
afraid it would be too hard". She called me at the start of the semester to beg for help getting her computer to work. 
I felt badly for her, as she was almost in tears over the technology. "Initially I was really excited about this class - a 
little nervous but when I logged on that was really smooth. Did the first homework, that was easy! Next day - went 
to lecture - no sound. Why? I tried everything - frustrated". This frustration plagued Sara throughout the course. "I 
was excited to begin. The freedom excites me. I can do it at 3:00 am if I want. This is the height of customer service. 
The best thing college can do for you. I'm not trying to keep up with you. At the same time it is scary. Am I doing 
this right or wrong? There is a loss of the personal touch.. "I do one lecture over and over again. I am not confident. 
There is no immediate feedback. I feel like I am groping. Anxiety - am I really learning? This is not a factor in 
normal classes". Her reaction to the course was entirely technology-driven rather than a reaction to the content 
covered. "I have lost confidence doing [the class] this way". 

Although case studies do not lend themselves to generalities, a list of the findings from these cases may 
help illuminate the students' experiences with on-line learning. These include: 

1 . The technology was problematic for some, particularly females. Confidence in the technology and in the user 
were important to a positive experience with the Web class. 

2. Instructor availability was important to all students regardless of their level of comfort with the technology. 

3. Attitude toward the subject did not seem to be affected by the Internet. In fact, students who scored low on 
exams still rated the class as "excellent" or "better than most". 

4. Enthusiasm was high at the outset of the semester, and with nurturing can remain high throughout the term. 

5. Motivation appeared to be the single most important factor affecting success in the Internet course. 

Either internally or externally motivated students fared better. 



Comparison of an Internet and Traditional College Science Course on Student Learning 

With a rudimentary understanding of the learning environment created by Internet-based Human Anatomy 
and Physiology course, a quantitative comparison of the effectiveness of an Internet and traditional course was 
conducted. The following questions were used to guide this study: 1) How does Internet-based science instruction 
effect student achievement? 2) How does Internet-based science instruction effect student study habits? 3) Do the 
students perceive Internet-based science classes differently than traditionally taught classes? 4) Do students enrolled 
in an Internet-based science class perceive their education differently than do students enrolled in a traditional 
science class? 

Five hundred seventeen students participated in the study; 457 and 60 in the traditional and Internet 
sections of Zoology 155, respectively. With the exception of the percentage of students enrolled as part-time 
students, the two sections were demographically similar. Student achievement in the traditional and Internet section 
of the class was assessed using grades earned on the four exams and assignments. Study habits were examined using 
a study habits survey adapted from Mohamed (1980). Also working with Zoology 155 students, Mohamed (1980) 
designed the original survey to assess the effect the availability of video presentations of class lectures had on 
student study habits. The modified survey was administered week 12 of the semester. In addition, the Attitude and 
Epistemology Survey was administered to examine students' attitudes and beliefs about science. This survey was 
administered in the second week of semester to determine students' attitudes when entering the course (not a change 
due to the course). T-tests were conducted on all survey and grade results to determine whether statistically 
significant differences existed between the two groups. 

The results of the Attitude and Epistemology Survey revealed no significant differences between the two 
sections (alpha = 0.05). The survey results were grouped into four categories based on underlying concepts: attitudes 
toward science usefulness, interest in the field of science, problem solving abilities (use of the scientific process in 
problem solving), and understanding of the scientific process. These survey results were analyzed using gender, year 
in school, reason for enrollment Zoology 155, and choice of Zoology 155 section enrollment as parameters for 
comparison. Regardless of which parameter was isolated, no differences between the two self-selected populations 
could be ascertained from the survey. 



When study habits were examined, differences appeared between the two sections. Tests were run 
comparing Internet section responses with traditional section responses. In addition, gender comparisons were made 
both within each section and between sections. Those enrolled in the Internet section reported missing fewer 
lectures, reading the text more often, reading a higher percentage of the required readings, and having more faith 
that the readings were an integral and helpful portion of the class than did those in the traditional section. The 
Internet students reported recognizing that their course allowed for different learning styles and self-paced learning; 
this was so for the traditionally taught section. The freedom to arrange study schedules around other classes was 
appreciated in the Internet section, while seen as indifferent in the traditional section. Responses to questions 
concerning the use of tutors, notes taken during the class, or outside resources such as experts or libraries did not 
significantly differ between the two sections. Males in the Internet section missed fewer lectures and relied more on 
the text than did the males in the traditional section. The males in the Internet section reported an increase in interest 
in the subject due to the class and an appreciation of the freedom allowed by the class. This same pattern also was 
evident when comparing mean responses in the two female populations. The females enrolled in the Internet section 
differed significantly from their traditionally-taught female peers in that they missed fewer lectures, relied more on 
the instructor- prepared notes and the textbook, found the lectures and readings more useful, and appreciated the 
freedom to schedule their studies. 

Overall course grades were slightly higher in the Internet section of the class. Scores on the cumulative 
final exam were significantly higher in the Internet section. Retention rates, analyzed by percentage enrollment 
dropping the course at midterm, were also different between the two sections. The Internet section lost a higher 
percentage of students than the traditional section . Achievement was not adversely effected by the use of the 
Internet as a means of course content delivery. 

The Internet has not created a better way to teach, but appears to have facilitated the use of instructional 
design methods that move the student toward more interaction with the material. The benefits seen are not inherent 
in the medium, but rather they are due to the effective use of the properties of the medium. The learning 
environment created in the Internet-section of Zoology 155 did not appear to adversely affect learning. Students 
enrolled in the Internet section of this college science course demonstrated more efficient study habits (such as 
spending more time interacting with the material, using the text and ancillary materials, and attending the lectures) 
than those in the traditional course. Their content retention was better than those students taught in the traditional 
lecture, and their study habits more closely resembled those proven to lead to success (Piaget 1975, Pintrich 1994, 
Posner, Strike, Hewson, & Gertzog 1982). 



Teaching On-line Courses: A Case Study of Instructors 

The instructor experience while teaching on-line was investigated to complete this look at Internet-based 
science instruction. The guiding question for this study was "How does internet-based instruction impact the tasks of 
the instructor and the instruction itself? To examine this, two faculty members teaching on-line college science 
courses participated in this study. The time they spent on the class, as well as their comfort level with their 
workload, course product, and teaching effectiveness were investigated. Data were obtained through interviews and 
observations during the spring 1998 semester. The two participants had been teaching in the Zoology Department at 
Iowa State University for at least four semesters prior to their involvement with on-line courses through ProjectBIO. 
Both were full-time employees of the University, although neither held tenure-track professorial positions. Both 
participants held earned Doctoral degrees in science. At the time of the study, they were each approximately 40 
years old, married and had children. 

One instructor, Dr. Jenson, had been with ProjectBIO for more than two years, and was teaching an Internet 
science class for the fourth consecutive semester. The other instructor (Dr. Douglas) was new to on-line instruction 
and would teach his first Internet-based course during this study. Dr. Jenson had taught his biology course on the 
Internet using the ProjectBIO protocol three semesters including a summer session. Spring 1998 represented his 
fourth run of this course through ProjectBIO. He had an enrollment of 70 students in his Internet section during 
Spring 1998. While not particularly outspoken, he attended all ProjectBIO meetings and presented issues for group 
discussion many times. Dr. Jenson's input on teaching strategies and administrative routines was sought after and 
respected by the ProjectBIO staff. 

Dr. Douglas was hired into the Zoology Department in 1995 as a spousal appointment. At the time of this 
study his position, like Dr. Jenson's, was defined as staff. His original duties included coordinating and instructing 
upper level laboratories, so few changes were necessary when Internet instruction was added to his responsibilities. 
The Internet course was viewed by the administration as equivalent to teaching one laboratory section. Dr. Douglas 



o 

ERLC 



i9b 



was given a sophomore-level biology class to instruct via the Internet. Dr. Douglas was first and foremost a scientist, 
and he viewed teaching was a small part of his job. At the start of the semester, he had nothing prepared for Internet 
delivery, although he had previously taught the course (via traditional methods) and was confident in his knowledge 
of the content. 

Dr. Douglas' lectures were not prepared until they were needed by the students, This did not allow students 
to work completely in an asynchronous manner. When asked about the time he spent on creating WWW lectures, 
Dr. Douglas responded "I spend much more time working on my WWW section. The preparation is very time- 
consuming. I spent 3 to 4 weeks working incredibly hard on getting my lectures done. It takes longer to do a lecture 
- it costs more to prepare”. When talking with his spouse, Dr. Douglas’ level of involvement with his Internet course 
was indicated. "He is demonstrating excessive signs of stress. He's not sleeping and staying up late several days a 
week. He writes out all his lectures, then reads them verbatim. He also does all his own graphics. He spends one 
hour per figure and has 5 to 6 per lecture. He wouldn't do that for live lectures". This high level of time commitment 
was indicated again when Dr. Douglas' spouse reported "I have hardly seen him for weeks. This definitely cuts into 
family time. He should have started in a more timely manner. Spring Break he began in earnest". In Dr. Douglas' 
opinion, he spent "longer on the WWW, and my time was not well spent. I had the entire lecture written out and 
tried to sound animated. I went back and edited mistakes - 1 fixed lectures because it's there and people hear it 3 or 4 
times". He created his own lectures, but did have help with HTML cue points and other technical aspects of web 
delivery. Learning these skills again required more of his time then he anticipated "I spent more time piddling 
around with the Web resources”. 

Because he had taught the course previously, Dr. Jenson was involved not in creating lectures, but with 
"maintenance and fixing to make it better". Dr. Jenson mentioned that "editing took an incredible amount of time. I 
had to do lectures all over again. You have to be more efficient and careful about what you are saying. I want the 
product to be good quality - this takes a fair amount of time. Just the audio took a lot of time". After the initial 
creation, Dr. Jenson planned to go back and fix up the lectures. "I haven't yet. I would like to add new stories and 
change the information that's in there. The development phase is long. Once its developed there's maintenance - 
well, more than that. It requires attention. New exam made up. I type all the exams in myself. I now know HTML - 
this is a nuisance that takes a while. Far longer than regular lectures. I should be tweaking the course, but I have no 
time". 

Both instructors talked about their feelings of job satisfaction while teaching on-line. They reported similar 
experiences. In an interview, Dr. Jenson noted "I do get frustrated doing all this. I feel I'm not using my time most 
effectively. With my experience and knowledge I don't need to be doing this [administrative work]. I'm not teaching 
[repeated twice]. In traditional classrooms, you feel like you are teaching. You have tried to communicate and some 
may have gotten it. With the Web, there's no immediate feedback. The e-mail has nothing to do with content at all. 
I'm not really teaching. The sense of personal satisfaction is a problem". Dr. Douglas’ interview comments mirrored 
this. "I generally dealt with only two things - all procedural questions. No course information, almost no content 
questions. I had only one or two questions on each assignment - was the paper available or is the content relevant? 
Student feedback is not enriching". There was a bright spot for the experienced Web instructor. Dr. Jenson was 
surprised by the level of interaction between student and instructor that this format provided. "The students e-mail 
me constantly, telling me things that I don't usually hear in traditional lectures". "I feel like I know these students 
personally, much more so than I do with traditional students." Even his spouse was able to see the relationship that 
developed between Dr. Jenson and his Web students. "He talks more about his Web students. He has more contact 
with those students. It's weird - especially the off-campus students". Dr. Douglas was not far enough along in his 
Web teaching experience to notice many differences in the student attitude, but he did notice there were fewer "no 
hope-ers" in his WWW class than he'd been seeing in his traditional classes. 

Despite the acknowledged increase in administrative work the instructors experiences in teaching via the 
Internet, their overall impression of teaching on-line was positive. Dr. Jenson's spouse noted "He has been excited 
about the possibilities of teaching in this way all along. He sees a lot of potential in on-line teaching". Dr. Douglas 
noted that "the on-line experience could be positive - it has the potential to be positive. I would like to do it again 
and do a better job". 



Conclusions 

The dynamic nature of the Internet makes it viable tool for instruction. As more and more colleges and 
universities offer on-line courses, it is important to understand the potential and limitations of the Internet as a 
means of instruction. The research reported in this paper suggests that the Internet can be an effective means of 
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college science instruction. The case study about students’ on-line learning experiences indicated that students enjoy 
learning on-line, and although students do not meet with instructors regularly, instructor availability was important 
to the students. Also, motivation is a key factor impacting student success in on-line instruction. 

When compared with traditional instruction, Internet instruction appears to be an effective method for 
teaching college science, as student achievement was not adversely effected. Students in an Internet course were less 
likely to miss lectures and used lecture notes and textbooks more frequently than those in the traditional course. 

Internet instruction changes the role of the university professor. The results of the instructor case study 
suggest that teaching on-line courses consumes more time than traditional courses. In addition to understanding the 
course content, instructors who teach via the Internet must possess technical skills to design and maintain course 
materials. Although the instructors spent a great deal of time designing and maintaining their web-based courses, 
they possessed positive attitudes about teaching on-line. 

To better understand the implications of Internet teaching and learning, additional research needs to be 
done. Future studies should examine instructional design and on-line instruction; policy issues with on-line 
instruction in higher education; and student self-efficacy in on-line courses. 
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Abstract: The Internet, particularly, the World Wide Web, has had a substantial impact on society. 
Whether or not these technologies will be able to effect beneficial change in K-12 education is 
another question. In the past educational reforms have often foundered due to a lack of teacher 
preparedness and on-going teacher support. This paper will discuss the experience and attitudes of 
a group of pre-service elementary school teachers enrolled in a required content mathematics 
course. 



There is a great deal of excitement about the Internet and the Web these days, and for good reason, the Web 
is an exciting technological development. The Internet is also touted as having the potential to revolutionize K-12 
education. The Internet may indeed have that potential, but there is much that will need to be done in order for that 
potential to be realized. One problem is simply availability of technology. There are still many schools and teachers 
who have very inadequate access to technology. There are two other categories of issues, one is the suitability of 
technologies and Internet and Web-based materials for actual use by K-12 teachers and students. These 
technologies and materials are often developed without the input of K-12 educators and may not suit their needs. 
One could think about this type of issues as the problem of developing the technologies in a direction which is more 
friendly to education and educators. The other category of issues is the mirror image of these issues. It is the issue 
of teacher preparedness to use the Internet and other technologies in an effective way. What do teachers need to 
understand in order to use the new technology effectively? How can we support teachers in their efforts to gain this 
knowledge? This is the problem of developing teachers who are well-prepared to use these technologies in creative 
and effective ways. Together these two problems combine to be the bigger problem of developing teachers and 
technologies which can together effectively educate our children. 

Putting together the Web, elementary school teachers, and mathematics, in fact has the potential to be a 
disaster. Elementary school teachers, are often, math-phobic and math-avoiding. Their knowledge of mathematics is 
often procedural rather than conceptual. In Liping Ma’s book, Knowing and Teaching Elementary Mathematics: 
Teachers Understanding of Fundamental Mathematics in China and the United States , a comparision is made 
between American and Chinese elementary school teachers. The American teachers have a much more superficial 
understanding of mathematics and less sophisticated teaching techniques. For example, the American elementary 
school teachers were much less able to explain the principles behind the algorithm for subtraction with borrowing 
than Chinese teachers. There is a danger, that teachers with weak understanding of mathematical concepts could use 
the Internet as just another source for materials which focus on procedure rather than on concepts. To quote Ainley 
and Pratt (1995, pg.85) 

The use of information technology to draw out mathematical 
potential is a relatively new area and thus demands a degree 
confidence and mathematical awareness . Primary school 
teachers may not have sufficient confidence or experience in 
mathematics to enable them to plan computer-related 
activities which will be rich in mathematical potential 

Just as computers in the classroom, often become merely tools for drill and practice, the Internet can offer 
elementary school teachers another way to avoid struggling with the concepts of mathematics and teaching children 
to do the same. 

At the beginning of the fall semester of 1999, I surveyed students enrolled in my mathematics content 
courses for future elementary school teachers. The students are almost all female and are almost all traditional 



students in the sense of attending college immediately after graduating high-school. They are attending a moderate- 
sized private college in Southern California. A total of 47 students in two sections of the course participated in the 
survey. 

These students are not computer illiterate, but they are unsophisticated in terms of their thinking on how to 
use this technology in the classroom. This is not surprising since most have not had much in the way of technology 
education. In fact, the youth of my students masked the degree that lack of technological knowledge is a problem in 
educating future teachers. At other institutions a large percentage of the students in a course such as this one would 
be re-entry students. These students are often computer illiterate and phobic, whereas my students are mostly just 
technologically unsophisticated. For example, only five students had any knowledge of programming in any 
language, and one student responded to the question about programming by asking what it meant to program. 

On the other hand almost all the students are regular users of email. 

I received 46 meaningful responses to the question: 

How often do you use email? Circle the response that best describes your situation. 



Response 


number 


percent 


At least once a 
day 


28 


61 


Several times a 
week 


12 


26 


Once a week 


2 


4 


Rarely 


3 


6 


Never 


1 


2 



Offered a choice of a variety of other activities that they might use the computer for, all of the students selected one 
or more. 



Activity 


numb 

er 


percent 


Word processing 


46 


98 


Game-playing 


27 


57 


Shopping 


13 


28 


At a job 


12 


25 


To get information in daily life 


21 


45 


To research for school 


44 


94 



At the end of the survey the students were asked to write, as specifically as possible, about how they see 
themselves using computers in their future work as teachers. Most of the answers were vague, not specific at all. 
On the other hand, it’s hard to be specific about the future. Forty students answered this question in some way. And 
the majority of the responses focussed on use of the computer as a tool to help the teacher with writing, grading and 
organizational tasks. Thirteen students mentioned using the computer to write lessons, worksheets, letters to parents 
or other materials, and eleven students mentioned using the computer to do grading 
Here are a couple of typical responses: 

/ am sure / will use computers to record grades and to create daily lessons. 

For keeping track of grades, maybe; making worksheets and tests; writing letters to parents. 

Also commonly mentioned was using computers or educational software for instructional purposes, this was 
mentioned in some form by eleven students. However, this is only 27.5% of the respondents. Nine students 
mentioned the importance of children developing familiarity with computers while young, as in this response: 




Because computers are becoming such a big part of our world. I think it is important that we teach our students at a 
young age so that they can become comfortable with them. I don 7 know exactly how but I want to integrate the use 
of computers into my classroom. 

Interestingly, given that 27 of the students mentioned that they play games on the computers, only two 
responses mentioned the value of educational computer games. Also, although these students almost all use the 
email, only two students mentioned that their students might benefit from using email, only one mentioned that 
students might use the Internet specifically, and only three mentioned that as a teacher they might use the Internet.. 
The numbers were also surprisingly low for the use of computers to do research, five students saw themselves as 
teachers using computers as a research tool, and three mentioned that their students might use computers as a 
research tool. 

Very few students were aware of any possible negatives involving the use of computers. Controversial 
issues, such as the correct balance between teaching paper and pencil computation and allowing the use of 
technology did not appear. The following response was interesting, both for the note of caution it sounds, and for 
the fact that this response was from one of the most technologically adept students. This student was one of the few 
who had taken a programming course, and mentioned a knowledge of both Basic and Unix. 

Computers are a major part of my daily life. I always have a computer around \ even when travelling. It will help 
organize me for teaching and keep my life in track. I plan to expose children to computers, however not a great 
amount because I want them to think, not for the computer to do it all. Rather have kids playing with hands not a 
clicker. 

There was one other cautionary response 

..../ believe that computers could slow down the creative processes of children, especially if all of the thinking is 
done by the computer. 

The lack of cautionary responses is troubling, since it suggests a superficial view of mathematics and of the role that 
technology can play in computer education. 

Preservice elementary school teachers are often weak in the area of mathematics. Their understanding, 
tends to be procedural rather than conceptual. Without a deeper understanding of mathematics and training in using 
computers in creative and rich ways, the Internet will become just another tool teachers can use to teach in the same 
old way. 
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Abstract: This paper will describe the University of San Diego’s web group, an unique and 
innovative service-learning experience for computer science students. 



1. How Did the USD Web Group Get Started? 

As the chair of the Math/CS department, Luby Liao receives frequent calls for help with computer related 
problems. In September of 1998, Catherine Crutchfield of the Dean’s office asked whether we can find a 
Computer Science (CS) student to help her set up a database application. A CS graduating senior Alphonse 
Esper took the challenge and worked on the project to her delight and satisfaction. We consider this the 
motivating event for the web group and fondly call Catherine the mother of the web group. 

We formed the web group in the Spring semester of 1999 after being encouraged by the satisfaction of 
both the student helper Alphonse and his client Catherine. The goals of the web group were simply: 

1 . to provide a forum for the students to study web-related problems and their solutions, and 

2. to help the USD community with their web-related problems. 

Given the frenzied interest in everything related to the web, we quickly attracted eight students to the web 
group. Two joined for independent study credit. The others simply did it out of interest. A group member 
Tom Hua embarked on a semester-long project of helping Michele Magnin, a faculty member in the Foreign 
Language Department, with her web-related problems. The web group was less active in the summer of 1999. 
Yet, at that time, a student member Jaime Garcia started helping Gretchen Ponts of the Graduate Admissions 
office with their web site. This has been ongoing and will continue until Jaime graduates in May of 2000. 

Just as web continues to grow, so does the web group. In the Fall of 1999, the web group became more 
visible. It now routinely received requests for help. Its 30 odd student members were busy helping many 
members of the campus. 

The clients are happy because they now know that there is an organization they can turn to, to ask for free 
help. The student servers are happy because they enjoy the satisfaction of helping others and learning in the 
process. They are proud to be respected as experts. 



2. Web Group Activities 

Internally, the web group meets weekly to present problems and solutions, to give presentations, and to 
listen to lectures. Students learn to use databases in their web applications to enable dynamic contents. They 
learn how to use different technologies such as PHP, JDBC, Java applets, CGI and JavaScript. They learn 
how to choose the proper languages (Java, Perl, Python or others) for a given task. They learn how to set up 
Linux server machines. 
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The web group gave three workshops in the Spring of 1999 and one workshop in the Fall of 1999. These 
workshops are hands-on tutorials to teach web site construction. The attendees first run a script to create a 
rudimentary web site, this takes just one second. The rest of the time is spent on learning how to polish (edit- 
publish-edit-publish) web pages using Netscape Composer, a free web page editor. 

The three Spring workshops attracted an average of about 5 attendees each. This was because the web 
group was young and unknown, and the workshops were not well publicized. In contrast, the Fall workshop 
drew an enthusiastic crowd of more than 50 people. We promised more workshops for those who were unable 
to attend. We attribute the success of this workshop to the fact that the web group has become more visible 
and to more aggressive advertising. The Fall workshop was followed by a reception, supported by the USD 
Enhanced Student/Faculty Interaction Funds, during which student web group members discussed new 
projects with faculty and staff. 

The web group has become a web help center for many. The following letter is typical: 

Dear Dr. Liao, 

The (newly formed) Committee for the Enhancement of Teaching and Learning is in the beginning 
stages of developing a "faculty development" web page. We are working with Media Services to 
develop the site. I was hoping to find a student intern to help with the maintenance. The committee 
recommended that I contact you to determine if any help is available through your department. I am 
the individual responsible for the web site as well as the coordination of events and workshops. 
Student help on the web page would be an invaluable service. Truthfully, I need all the help and 
direction I can get on maintaining this web site. I'm just a novice. Thank you in advance for your 
help on this subject matter. 

The following appreciative comment from Gretchen Ponts, Graduate Admissions Officer is equally typical: 

For various and a sundry reasons we found ourselves in a pickle. Our web site stated old application 
deadlines and outdated applicant information, and no one in the office knew how to update the site. 
I contacted Dr. Liao because I heard he organized a student web group and was hoping to find a 
student willing to help us. Jaime Garcia came to our rescue by helping to update site information, 
creating one of our site links, and fixing java script errors. Jaime also offered to teach me how to 
work on the site so we wouldn't find ourselves stuck again ! Many thanks to Jaime, Dr. Liao and 
other members of this web group ! 

Sincerely, Gretchen Ponts Graduate Admissions Officer 

As of December 1999, there were roughly ten web group students actively helping USD faculty/staff and 
offices. 



3. How Do We Recruit Web Group Students? 

In the Spring of 1999 when the web group got started, we recruited eight students by word of mouth. In 
the Fall of 1999, Luby Liao taught a Topics course in Web Programming which had an enrollment of 34 
students. We decided to build a service learning component into the class, all the students are web group 
members by default. In order to have a group of comparable abilities, we also decided not to recruit new 
members. One highly motivated student, Johnny Bui, did join the group and made great contributions helping 
others, although he was not enrolled in the University for the semester. 

In the Spring of 2000, we will be back to word of mouth recruitment. We already have a core of about 
ten students. We expect an active group of more than 20 students. 



4. Future Directions 



For now, the web group primarily serves the USD community. But we hope it can serve a larger 
community in the future, including K-12 school teachers. Two current web group members, Jeff Wagner and 
Susan Spencer, have begun a K-12 outreach effort. These students are working with Hidden Valley 
Elementary School in an effort to get all the teachers on-line. They plan to use Perl to create an object-oriented 
program which teachers at the school can use to create their own web sites. They also hope to develop a 
database which will contain student information and could be accessed by parents to keep track of their 
childrens’ progress. 

Jane Friedman, one of the authors, has been brainstorming about helping local K-12 school teachers. One 
of the ideas is to collect phased out Pentiums, put the Linux operating system on them, and give them to K-12 
school teachers on condition that they be trained to use them. To motivate the teachers to apply for these 
machines and mandatory training, the teachers should be compensated for their time and effort. We will 
apply for grant to make this possible. 
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Abstract: The paper presents the way of organizing distance learning course on the 
sample of discipline “Artificial intelligence”. Peculiarity of the project is in adaptive 
character of education, i.e. in possibility of distance learning system implemented 
for development courseware to be arranged under individual features of the concrete 
user. The aim of the system is to define the best program of education for him by 
adapting scenario of the learning material and to help in the process of navigation. 

Adaptability is especially important for educational applications on World Wide 
Web which are expected to be used by very different groups of users without 
assistance of a human teacher. 

Introduction 

Distance education is of great popularity nowadays. The majority of existing in the Internet distance learning 
(DL) courses present by themselves static electronic copies of regular textbooks: chapter by chapter, page by 
page. So different users (further we will call them “students”) get the same educational material in the same 
form. Some of the existing courses may possess test subsystem for checking how the student gains knowledge. 
But test results do not have influence upon the program of education. 

One and the same material may be differently understood by different students. It can be rather easy for the 
student with some preliminary knowledge of the subject domain and difficult for the student without any basic 
knowledge. The student may need help to orient himself in hyperspace, especially if it is large and complex one, 
to know where he is or how he can reach a given piece of information. Without help he may get lost in hypertext 
area. 

It is necessary to take into account student’s preferences, goals while he chooses particular DL course. In 
dependence with this information the student should be presented necessary volume of the learning material. He 
may be given only basic questions. Or if the student knows material rather good but wants to define some of the 
questions more precisely he may be directed to the glossary (list of subject domain terms with the links to the 
texts) without looking through all the course material. Approach described in this paper is aimed at investigation 
of possible strategies for automatic adaptation of a DL system to the concrete student. It is supposed that the 
system may use the following characteristics of the student: goals, subject knowledge, hyperspace experience, 
personal characteristics (demographic, professional, physiological and psychological), preferences. 
Development is based on the concept of the “student model” that presents a formal description of student’s 
characteristics. It is obtained through his interviewing and is getting more precise dynamically in the educational 
process according to the results of the intermediate examination tests. 

Subject domain of the course - Artificial Intelligence — is not enough presented in the existing distance learning 
courses. The course is intended for teachers giving lectures on Databases and Knowledge Bases, scientific 
researchers, students, post-graduate students are interested in the problems of Artificial Intelligence and 
Distance Learning. 




Architecture of the adaptive DLS 

Architecture of the adaptive DL system implemented for development coursware is presented on figure 1 . 
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Figure 1. Architecture of the adaptive DL system 
It consists of the following components: 

• Administrator’s workbench - fulfilling functions of system administering. System administrator may add 

and delete users (teachers and students), enter all necessary information about them, assign teachers to the 

students. 

• Teacher’s workbench - accumulation and provision of knowledge on subject domain, maintaining 
examination tests, analysis of the student “feedback”. Teacher can get all information about his students: 
students’s characteristics, information about the state of educational process (learned part of the course 
material, test results). 

• Structure of the subject domain - documents presenting program of education. 

• Tuning block of the student model - determination of student’s level. 

• Tuning block of the learning session model - determination of the route of education. 
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Navigation in education 



Learning material is presented in the form of hypertext. But not the whole hypertext area may be accessible for 
the concrete student. He is presented only those links that lead to parts of the course with the material 
corresponding to his level. In the context of education the student do not passively examines learning material 
but also learns a certain amount of relevant information. Therefore the system includes some level of control by 
means of testing. The student may be left free to examine some area of the course but before passage to the 
following area the system checks how he gained the material. 

In the process of navigation he must pass some intermediate examination tests which results define the further 
route of education. He is not presented the following part of the material until he doesn’t successfully 
overcomes corresponding test. In case of wrong answers to the questions he is returned back to the previous 
parts of the material that he didn’t understand enough. The navigation within the mastered area of the material is 
unrestricted. 

It is possible to distinguish several student levels in dependence with the volume and complexity of the learning 
material and according to the students’ characteristics. The system allows to chose scenario of the learning 
material to each student level. In our case the volume of learning material is not large so the course is developed 
with the use of two user models: “novice” for whom profound learning of the material would be difficult and 
only part of the course including basic questions is presented for him and “professional” for whom the whole 
learning material is presented. 

The users who found themselves on the main page of the course can get information of common character 
about the proposed learning program and developers. They are able to look through the contents of the course 
(titles of chapters, paragraphs). Besides, for better understanding the structure of the course is presented in the 
form of graphical schemes - Atlas. It allows to discern classes and subclasses, concepts and objects of the 
subject domain, reflect semantic connections between them. The functional meaning of Atlas is to give full and 
clear notion of the subject domain. Navigation in the hypertext area is also possible through these schemes. One 
of the schemes is presented on figure 2. 




Figure 2. 

But only the registered users (“students”) can get access to the learning material. First of all the student must 
pass preliminary testing that reveals his characteristics and on it’s basis indicates his level: “novice” or 
“professional”. In dependence with its results the corresponding structure of the course is chosen. 

After each part of the course he is given intermediate examination test. It may be close with several variants of 
answers or open. The system automatically sets mark and defines the further route of education. In the 
educational process the system dynamically gathers the following information about the student: performed 



actions (login, logout, learning particular document, test passage) with their dates and time, test results. The 
student is provided with feedback to the teacher. So he is able to address the teacher for explanation some 
incomprehensible parts of the learning material. Each time when the student finishes the educational session the 
system remembers the address of the last visited page. Therefore beginning the next educational session he finds 
himself on this page. 

In case of successful overcoming of all the tests the learning course is finished. 



Program implementation 

Intelligent Distance Learning Environment IDLE developed and implemented for creating and management of 
the adaptive DL system, is a three-layer 100% Pure Java toolkit which provides all the necessary functionality 
for developing, maintaining and using adaptive courses, Java application makes possible for the users of the 
system to fulfill their functions from any point in the Internet, 

The lower layer of the system is SQL (structured query language) DBMS (database-management system) with 
the database. It contains structure of the course graph, rules for passage between it’s nodes, student models and 
protocols of educational sessions, some administrative information. 

Middle tier - application server is a Java application which provides its services through RMI. It is connected to 
the database using open interface JDBC (java database connectivity) API. 

Client software - higher tier - never modifies the database directly, only through the high-level API. This 
standard approach guarantees the portability of the environment between different SQL servers. Client software 
are the Java applets running inside any standard modem browser having JDK- 1.1 compatible JVM. 

For specifying rules used in the course graph, the Scheme language is used. The mature, pure Java 
implementation SILK/JLIB (http://www.norvig.com, http://www.cs.brandeis.edu/~tim) is incorporated into the 
system as a scripting language, so course developers can write rules of any complexity. Each rule comprises the 
expression which result is considered as a weight ot the corresponding course link. Largest value gives the link 
which the system chooses for the further movement. 

For developing test subsystem XML (Extensible Markup Language) is applied. The DTD (Document Type 
Declaration) and example describes all the possible types of tests which IDLE can manage. Using XML in the 
system provides general flexibility and extensibility. It is the most flexible way to handle student model. 

Atlas of the subject domain is presented with the use of tool Pegas developed in the Laboratory of Artificial 
Intelligence of the Institute for High Performance Computing and DataBases (http://www.csa.ru/ailab). 



Conclusions 



The work is now in progress. The approach described in this paper may be implemented for different 
disciplines, not only for artificial intelligence (for example, course on cognitive sciences - psycho-linguistics 
and neuro-psychology - is being in progress parallel to the course on artificial intelligence). It allows to adapt 
structure of the learning material presented to the student. 

Further directions of work are the following: 

1 . Today the system uses link-level rules (i.e. rules associated with particular course links) for specifying the 
strategy of the educational process. This is not a problem for small tutorials, but for large courses, higher 
level of methodical knowledge should be used. The most important goal of the project is to reach the ability 
to define some course-level rules for the adaptive behavior of the system. 

2. The concept of student model should be reviewed. At present it is completely static, the only really dynamic 
variables in rules are ones from student protocol. The system should provide the ability to change 
parameters of the student model dynamically. Moreover, this model can be used for changing not only the 
content of the course but also the user interface of the system. The interface should reflect student’s 
progression using advice, for example. 

3. Developing multi-agent system - developing several agents that will communicate and help both teachers 
and users. 

Acknowledgements 

The work is partially supported by Russian Foundation for Basic Research (grand 98-01-0081). 



References 

Ellsworth, J.H. (1994). Education on the Internet. Indianopolis: Sams Publishing, p. 591. 

Gavrilova, T., Averbukh, E., Voinov, A. (1996). An Approach to Learning Software Based on Student Modeling. Lecture 
Notes in Computer Science N 1108: Third International Conference on Computer Aided Learning and Instruction in Science 
and Engineering. CALISCE'96 , San-Sebastian, pp. 448-450. 

Gavrilova, T., Voinov, A. (1995). Adaptive Interface Design and Scenario Control via User Modeling. In: Preprints of 
IFAC/IFIP/IFORS/IEA Symposium on Analysis, Design and evaluation of Man-Machine Systems, MMS'95. MIT, 
Cambridge, pp. 535-540. 

Gavrilova, T., Voinov, A., Zudilova, E. (1995). User Modeling Technology in intelligent system design and interaction. In: 
Proceedings of East-West International Conference on Human-Computer Interaction HCP95 , Moscow, pp. 115-128. 
Chernigovskaya, T.A., Gavrilova, T.A., Voinov, A.V. Udaltsov, S.V. (1998). Intelligent Development Tool for Adaptive 
Courseware on WWW. Proc. of 4 th Int. Conf. On Comp. Aided Learning and Instruction in Sc. And Eng., pp. 464-467. 
Chernigovskaya, T.V., Gavrilova, T.A., Voinov, A.V. (1997). Neuro-cognitive Bias for Distance and Computer-Aided 
Learning. In: 8th Inti. PEG Conference - " Meeting the Challenge of the New Technologies ". 30th May - 1st June 1997, 
Sozopol, Bulgaria. 

Kaas, R. (1989). Student Modeling in Intelligent Tutoring systems - Implications for User Modeling. In: User Models in 
Dialog Systems, USA. 

Rich, E. (1983). Users are Individuals: Individualizing User Models. Int. Journal of Man-Machine Studies , 3, No. 18, pp.23- 
46. 

Zucca, G. (1996). On the Internet: Online Writing Clinics on the World Wide Web, yllabus, Vol. 10, No3. 

Gorodetsky, V.I. (1996). Multi-agent systems: current state of research and the application perspectives, In: Proc. V 
Nat.AI.Conf.KII-96 , pp. 36-45 (in Russian) 

O’Hare, G., Jennings, N. eds. (1996). Foundations of Distributed Artificial Intelligence. Sixth-Generation Computer 
Technology Series. Branko Sousek, Series Editor, John Wiley & Sons. 

Brusilovsky, P., Eklund, J., and Schwarz, E. (1998) Web-based education for all: A tool for developing adaptive courseware. 
Computer Networks and ISDN Systems {Proceedings of Seventh International World Wide Web Conference, 14-18 April 
1998) 30 (1-7), 291-300. 




Virtual-Real Lab: an Electronics Laboratory Using Real Devices and 

the Internet 



Humberto Gomes, Rita Pivetta, Luigi Cairo 
Departamento de Engenharia Eletrica - Universidade federal do Rio Grande do Sul 
Av. Osvaldo Aranha 103 - Porto Alegre - Brasil - 90035-190 
carro@iee.ufrgs.br 



Abstract: This paper presents the design and utilization of an Electronics Laboratory, 
physically available through the Internet. One of the greatest advantages of this project is to 
offer to many students the possibility of achieving practical experiments in the electronics 
field without the need of their presence in the laboratory room. This paper shows the 
hardware used to develop the system and the frontend web page with the required security 
involved. 



Introduction 

Computers have been extensively used in Electrical Engineering education, thanks to the available 
graphical interface and to programs able to solve a set of differential equations. Actually, there has been 
reported a large number of software tools and their use in a real or a virtual classroom (Oakley 1996, Canizares 
1997, Mehta 1996). Distance learning using the Internet has bloomed (Coleman 1998), but one of the main 
resources of learning has been almost always forgotten: the laboratory. Simulation, although helpful, by no 
means can replace real experimentation. On the other hand, it is very hard to offer a real laboratory for all 
students, open any time of the year and near his/her home. There has been some effort to allow students the 
access of a virtual lab in some specific niches like power systems control (Patton 1996) and control engineering 
(Aktan 1996). 

This paper presents our contribution to allow access to a basic laboratory useful in electronic 
disciplines. Our main goal is not to substitute the presence of students in a real laboratory, since this is still 
required to develop their manual ability with components, to feel temperature of burning resistors and the like. 
The goal is to work as a complementary laboratory, working round the clock, where the student can achieve 
experiments without leaving home, getting further motivation to frequent regular laboratory classes. 

There are other related advantages in using our proposed Virtual-Real laboratory. First, a lot more 
students can use some rare components, difficult to find or even expensive ones in security. Moreover, like 
simulation, the Virtual-Real Laboratory enhances the concept of active learning (because it allows easy 
modifications) and data collection facilities. 

In the Virtual-Real Laboratory the student can assemble a real circuit and check its behavior through a 
web page. This page shows the set of available components and the student chooses which of these components 
will be used in his experiment. After the circuit is completely defined, its specification is sent to a 
microcomputer (in a real lab) physically connected to the protoboard where all components stay. Based on the 
specification received, the computer controls component selection and switching on the protoboard. A 
configurable board placed between the computer and the protoboard, in fact, carries out component switching. 
A control software running in the host computer is responsible for the correct working of the configurable 
board. 

After component switching is done, signals read from the circuit are sent to the student who is now 
able to analyze them with a visualization tool, available from the Virtual Real Laboratory home page. This tool 
simulates an oscilloscope, so that the student is provided with the same resources found in a real laboratory. 
Since this project has an academic goal, a new circuit can be proposed to the students on every week, so that 
they can make experiments and take conclusions in a practical and comfortable way, through the Internet. 

This paper presents all the hardware and software developed to support the Virtual-Real Laboratory. 
Section two presents the configurable board, developed to support circuit component switching. Section three 
describes the Virtual-Real Laboratory home page from which the student can make his experiment. The 
visualization tool is described in section four. Finally, section five presents our conclusions and future work. 




The configurable board 



The configurable board developed for this work, also called ASA matrix (from Analog Switching 
Array), is based on the MT8816 integrated circuit by Mitel Telecommunication. Each of these ICs is an array of 
16 programmable analog switches connected by 8 connection nodes. Four MT8816 were used to obtain a 
matrix of 32 switches and 16 connection nodes as shown in Fig. 1. 




Figure 1: Configurable board. 

All connections keep their state until a new addressing process is done or the RESET signal is 
activated. In this last case all switches are opened. Besides that, the CS (chip select) signal for the IC must be 
active when an addressing process is taking place. The control and addressing signals are common to all 4 ICs 
except for the CS signals, which have individual wires to enable the identification of which IC will receive the 
addressing data. Control signals come from an auxiliary board (control board) which interfaces to the 
computer. This board is connected to the computer parallel port and controls the ASA matrix board. It also has 
the connection terminals to the signal generator and to the analog to digital converter that captures data read 
from the electronic circuit. The control board processes data received from computer to send them to the ASA 
matrix. Then, the ASA matrix executes the operations to connect the correct electronic components in the 
circuit. Fig. 2 shows a snapshot of the actual system. From left to right one can see the control board, 
responsible for computer interfacing; the ASA matrix and the protoboard that contains the electronic 
components that will make up the circuit. 




Figure 2: photo of the system 



The virtual-real laboratory home-page 

Fig. 3 shows the virtual-real laboratory home page (NCSA 1999) which shows the electrical 
schematics of the circuit to be tested and the available component values. These values are previously set by a 
lecturer according to the type of exercise to be implemented and to the circuit characteristics to be exercised. 
Through this page the user also sets the excitation and measurement points. This page, still in beta testing 
phase, is available at http://www.lvr.iee.ufrgs.br 
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Figure 3: Virtual- real Laboratory Home-Page 



The Virtual-Real Laboratory has a dedicated HTTP server (Sambar 1999) that makes the page 
available to the Internet. To test the circuit the user sets, in the page, all needed information, particularly 
choosing those components that will be used in his experiment. These information are forwarded to the HTTP 
server, which in turn, starts a CGI program on the computer that has the board, sending to this program all 
information set by user. The CGI program is responsible for direct communication with the board control 
software, and sends the received information to the control software, which will execute component switching, 
and, by consequence, final circuit set up. After the switching process is done, circuit response signals are stored 
in a data file whose name is informed to CGI. Then, this program builds a result page from which the user can 
save the data file in his local disk and analyze it a posteriori, using the visualization tool described in the next 
section. 

Remote access to the page is granted to all students at any time. Since two students should not be 
allowed to execute experiments at the same time, there must be an access control. Access blocking is done 
when CGI gets running. If a student tries to begin an experiment when another is already in place the CGI 
associated to the second student informs him that the board is busy. When the CGI program is started by the 
HTTP server, it verifies if another user is already using the board. If so, the CGI program sends an error 
message to the user indicating that the access was unsuccessful. Otherwise, circuit information from the page is 
stored by CGI program in a switching file that is read by the board control software. The CGI program goes to 
a wait state until switching is finished and data read from the electronic circuit is available. With all data read 
and stored in a file, the CGI program makes the file available for download and notifies the board control 
software that access is enabled again. The board control software always begins execution after verifying the 
existence of the switching file created by CGI program. If the file exists the software proceeds with circuit 
switching, response signal capturing and data storing. After that it informs the file name to CGI, waits for the 
end of CGI program execution and re-enable board access. 
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The visualization tool 



The visualization tool simulates the functions of a digital oscilloscope with all the resources 
generally found in this equipment. This way, the user can work with the wave forms read from the electronic 
circuit via Internet as he would view them in real-time at laboratory. The oscilloscope also has a spectrum 
analyzer to introduce some basis of frequency spectrum to the Fundamental Electronics students. The resources 
of this software can be seen in Fig. 4, which shows a snapshot of full oscilloscope program screen. 




Figure 4: the visualization tool 

In the top half portion of screen one can view the waveforms read from the electronic circuit. These 
signals keep moving on screen exactly as they do in a real lab oscilloscope. There are 2 signal channels, one of 
them is the signal applied to circuit and the other is the read response. The oscilloscope offers visualization 
resources such as time and voltage division. All controls work independently for each channel. Trigger options 
can be selected to force the beginning of waveforms at left screen limits. Autoset feature allows the automatic 
adjust of waveform on screen accordingly to its frequency and amplitude for the best view. There are also math 
operations such as channel multiply, addition and subtraction as well as channel visualization controls. The 
measurements panel shows frequency, period and peak-to-peak voltage amplitude of each wave form (channels 
1 and 2). In the bottom half portion of screen one can view the signal frequency spectrum in RMS or phase 
mode. User can select the channel whose spectrum is to be shown, having the option of amplifying the 
amplitude to observe minor intensity harmonics. 



Conclusions and future works 
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The number of services provided via Internet is growing fast. This is due to several reasons, among 
them the easy access to information and the low cost for installation of these services. More and more people 
are using this important tool for a variety of purposes: shopping, fun and specially education. There are no 
doubts about the importance of the Internet for scientific and technological development. The number of 
Internet sites dedicated to education and knowledge forwarding is enormous, but on the other hand, this is not 
enough to implement a distance learning program. These sites just make the access to information easier and 
don’t free the student from going to the educational institution, since concepts must be explained and exercised, 
and doubts eliminated. 

This project does not intend to substitute a real electronics laboratory, but to make possible to many 
students the access to practical experiments at a relatively low cost, using a simple and effective work method, 
in which students interact with real circuits instead of just consulting databases. All of that makes Virtual-Real 
Laboratory an important learning tool for all those people interested in upgrading their knowledge in 
fundamental electronics. Future work includes some more sophisticated security systems to allow student 
evaluation. In this case there would be a lot of possibilities such as automatic exercises correction and different 
ways to effectively implement a circuit 
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Abstract: This paper describes a set of research based instructional plans being developed by a 
multidisciplinary team of researchers at the University of Nebraska within a National Science Foundation 
Proof-of-Concept Grant. The project is seeking to establish a prototype effort for teaching mathematical 
modeling within a technology based learning environment, which includes components of adaptive 
instruction for the student. Seven curriculum based design principles for the adaptive instruction that are 
being followed in the development of the project are described in the paper as they relate to research on 
effective mathematics instruction, and in particular the enhancement of mathematical modeling activities. 



Why Mathematical Modeling? 

This paper describes seven design principles, and related development plans, being integrated into a 
curriculum design project within the context of a NSF Proof-of-Concept grant. The project is targeting 
mathematical modeling as a content area within the project, because mathematical modeling is both an important 
topic in today's mathematics classroom, and an unusually difficult process to teach in the traditional classroom. 
Mathematical modeling can be defined as a mathematical process that involves observing a phenomenon, 
conjecturing relationships, applying mathematical analyses (equations, symbolic structures, etc.), obtaining 
mathematical results, and reinterpreting the model (Swetz & Hartzler, 1991).. It is essentially a systematic 
generalization process, where the mathematical model (such as a mathematical expression or algebraic formula) 
attempts to describe the mathematical relationships for a group of problems or situations, and is refined over a 
period of time with additional testing or use of the model. 

Mathematical modeling can be difficult to teach in traditional formats, such as lecture, and often requires 
considerable student involvement. Part of the difficulty in the instruction of mathematical modeling, is that 
considerable flexibility and feedback is often needed to work with the student (Smith, 1997). As a student's 
understanding evolves, their conceptual model may go through many different evolutions, hopefully becoming more 
refined over a period of time, and with more instruction and feedback. Often, if a formula can be used to represent 
the model, the formula evolution itself may somewhat represent the evolution in the modeling process. 

Mathematical modeling is in essence a "scientific inquiry" process for mathematics, and can be thought of as being 
undertaken in a series of four stages, which become cyclical as the model refines. Four stages can be considered 
within the mathematical modeling process typically undertaken (Swetz & Hartzler, 1991). These stages include: 
Stage 1 - Observing and Discerning (observe the phenomenon or problem); Stage 2 - Conjecturing (proposing a 
mathematical or symbolic representation of the problem; Stage 3 - Applying Mathematical Analysis (converting 
relationships within the data based model to mathematical equations or expressions); and Stage 4 - Interpreting 
Results (test the model, and obtain results and interpret them in the context of the original problem). 



The Teaching of Mathematical Modeling 

Mathematical modeling is a key process for the complex problem solving that takes place in businesses and 
industry, and applied mathematics in engineering, as well as other fields. Due to the applied focus of mathematical 
modeling, there are lots of real life problems lending themselves to mathematical modeling, such as predicting 
wildlife populations, costs of long distance phone calls, irrigation flow rates, and even the fastest line to enter in a 



check out stand at a grocery. From a classroom perspective, these problems often lend themselves well to interactive 
multimedia and technology based instruction, where a simulation might be used as part of the instruction, as well as 
a systematic questioning process involving student dialogue or discussion. The use of such interactive activity 
within an electronic course format can be a powerful mechanism for building the knowledge base of students, as 
well as assessing the individual skills of students (Richards, Barker, Meng Tan, Hudson, and Beachman, 1997); and 
such work has already been successfully integrated into limited knowledge transfer systems. 

The effective instruction of mathematical modeling within a classroom context or related course format is 
often built upon several important assumptions or considerations (Ostler & Grandgenett, 1 999). These include the 
following: 1) Students have some control over how they approach the problem, 2) Good modeling activities are 
adaptable to many different ability levels, 3) Good modeling activities are scalable to different grade levels, 4) 
Problem solving and mathematical modeling are retained as different but related processes, 5) Mathematical 
modeling is used to focus primarily on the general case, and 6) The mathematical modeling is assessed carefully 
within the learning process, since even a poor model may build student understanding as it is tested, and then 
discarded by the student. 



Adapting Instruction for Effective Mathematical Modeling 

The designed project undertaken within this NSF Proof-of-Concept project is initially targeting the 
instructional topic of acceleration, which is a common topic covered in a variety of developmental mathematics and 
science courses. Especially relevant to the choice of developmental math for the prototype design effort is the fact 
that developmental math courses are taught in 72 percent of four-year institutions of higher education in the U.S., 
and nearly every (99 percent) two-year colleges. Students in these remedial classes are often nearly on their own, 
left to work their way through a textbook with only a graduate student instructor available to answer questions and 
offer assistance. Many universities, including the University of Nebraska system, are not able or willing to use 
scarce and expensive instructors in what are essentially seen as remedial courses. Using the instructional approach 
being planned within the design process, if expanded, would provide the advantage of more interactive and 
personalized instruction than what is usually now available in such developmental math courses. 

The overall vision for the technology based learning environment that is being designed in this NSF Proof- 
of-Concept endeavor is one which is consistent with the vision of new technology based resources as recommended 
by documents such as the 1996 NSF document "Shaping the Future: New Expectations for Undergraduate Education 
in Science, Mathematics, Engineering and Technology.” In addition, the use of a technologies that assist individual 
learners with different instructional styles and educational opportunities is a key design consideration. Within this 
context, the project is also striving to develop technology-based applications which can help illustrate the utility of 
“learning communities” within such instruction, that can provide a flexible and extended learning process which 
might take place both inside and outside of the traditional classroom walls. The possible contribution to a student’s 
individual learning process, as represented by such learning communities is just now being fully recognized. As 
described by the SRI International Center for Technology in Learning, in the report Future Visions by the United 
States Congress Office of Technology Assessment, the educational potential and utility is considerable : “the 
effective use of this technology could alter the relationships between homes, schools, and workplaces and in so 
doing assist the creation of new kinds of communities — communities that have learning and teaching at their core 
and use digital technologies to foster higher levels of community participation, enable deeper levels of cognitive and 
social engagement, and structure new kinds of relationships that support education.” (From Future Visions, Kozman 
and Grant, 1995, pg. 121) 

In order to ensure that the project is designed with the individual student learning process as the priority 
consideration, research-based educational design principles are being carefully integrated into all aspects of the 
project development. In essence, the educational vision for the adaptive instruction to be used within the project is 
such that the instructional process will embody the following seven design principles. 

Design Principle I) The adaptive instruction will seek to be a use of technology that helps students learn through 
involvement with real life problems, real life data, and true examples of mathematical modeling as they apply to 
today 's world . 

The use of real life problems, data, and tools within the context of technology based mathematics 
instruction has long been recognized as a beneficial contribution to student learning (Corbat, 1985). The availability 
of the Internet has expanded the teacher's selection of such modeling resources and software, which are now 
available to a much greater extent than they were even five years ago (Harvey and Chamitski, 1998). It is this new 
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networking capability that promises to provide teachers everywhere with an enhanced opportunity to incorporate 
mathematical modeling activities into existing curriculum and to give their students a chance to undertake modeling 
activities that are fairly realistic. For example, students might examine actual census data using new statistical tools 
to create their own predictive model of a societal trend. In addition, such new resources and tools also suggest the 
potential for a wider use of mathematical examples across grade levels, with greater flexibility in how a student 
might approach a mathematical modeling activity. For instance, real life examples related to optimization were 
normally not taught until Calculus, but with the appropriate graphing technologies, students at lower grade levels 
can learn to interpret and build mathematical generalizations based upon graphical information as well as the 
traditional calculus approach. This exposure in the lower grades (i.e. algebra or geometry) would set the stage for 
much more meaningful problem solving and mathematical modeling when the same students reach Calculus and 
study optimization as a formal topic. 

Design Principle 2) The adaptive instruction will seek to actively rather than passively involve students, in deep 
conceptual questions and encourage them to be both dynamic and flexible in their thinking and problem solving . 

A fundamental instructional idea behind mathematical modeling is that students, through modeling 
activities, discover patterns and consistencies in data that will allow them to test, refine, and build generalizations by 
creating a "mathematical machine" which represents a particular situation (Smith, 1997). This "machine" would 
provide them with a means for conjectures and predictions that might be tested using data sets, or systematic trials. 
Thus, the mathematical modeling process by a student typically goes through several modifications or refinements 
in order to produce a model which is more accurate, faster, or efficient. The creation of such a mathematical 
machine by a student, and its testing and refinement, is typically a very interactive process. Such systematic 
thinking within the mathematics field by a student is similar to they might undertake using the scientific method 
within a science class, and parallels that process closely. It also helps students understand that true mathematical 
application is much more than the mere routine application of formulas and strategies that they may have 
experienced in some mathematics instruction. 

Design Principle 3) The adaptive instruction system will seek to be an additional resource to teachers and 
classrooms, rather than a replacement for these valuable assets to student understanding. 

The design project being undertaken in this effort is striving to enhance rather than replace the important 
synergy that often happens between a teacher and student in the learning process. Within this context, the 
technology being designed seeks to facilitate the shared thinking between a student and their teacher, or a student 
and other students. The technology should also help organize and coordinate the technology based resources 
available to a student within the classroom environment, in addition to the teacher. For example, students often 
don’t know what technology based tools might be useful for helping with a particular mathematical modeling task. 
How might they use a spreadsheet to help examine their data? How might they test some of their evolving ideas 
within a mathematical simulation? Where might they go on the web for additional information on a modeling topic? 
This third design principle then seeks to permit the student as much control as possible within the learning process, 
and still help the student structure their thinking, and coordinate the access of their classroom resources, so that they 
can work more efficiently and use their resources more effectively. 

Design Principle 4) The adaptive instruction will seek to enhance human interaction, by connecting students more 
effectively with the teacher, their peers (other students), and appropriate mentors (professionals) during the 
mathematical modeling process. 

Based upon the student level, interests, and local resources and professional availability, the system will 
also suggest opportunities for students and professionals to work together electronically and collaboratively to 
confront modeling challenges as a “affinity learning group”. Similar to electronic special interest groups or listservs, 
but more focused on a particular task or set of activities, these affinity learning groups will move forward together to 
share ideas and activities occurring on the system. In this way, students can tap the thinking of other students, as 
well as designated professionals. 

Enhancing the ongoing dialogue between students and their teacher, students and other students, and 
students and other professionals, within such affinity learning groups is an important component targeted in the 
project design. Cognitive coaching and affinity learning as proposed in this project, have already been used 
successfully online in several classroom focused projects. For example, the Electronic Emissary Project, from the 
University of Texas at Austin, was able to match a wide range of students with scientists and other professionals to 
assist in answering questions on-line and for engagement in focused problem solving (Harris, 1996). This project 



would expand and add to such efforts by having the technology within the project assume a greater role in the 
facilitation of the structured dialogue process. 

For extending student access to content expertise within the mathematical modeling process, the design 
team is targeting the development of something called an “Inquiry Garden” or “Knowledge Garden”, where 
questions can first be asked by a student to an interactive system. If the system can understand and respond to the 
student question, it does so based upon a stored database of knowledge related to the question, providing immediate 
feedback. If the student wants additional information, or doesn’t feel that the information is helpful, then the system 
can forward the student’s inquiry to a peer group of learners, or to the teacher, or to an outside expert or 
professional. As these individuals contribute new content based answers to the student, the system might store this 
new response, and index it as part the existing knowledge stored within the system related to that type of question. 
Such an extended and systematic inquiry process should help the student organize their thinking a bit, and efficiently 
tap the important resources represented by the thinking and feedback of others, as they work through a challenging 
mathematical modeling activity. For this important design feature of the project, the project is building upon the 
previous work of Henninger (1997, 1996), one of the Pi’s of the project. 

Design Principle 5) The adaptive learning system will help with the ongoing assessment of student understanding, 
through a systematic use of embedded assessments, as well as student self-assessment . 

The systematic assessment of student understanding is a very important piece of the interactive technology 
being planned within the project. As educational technology continues to rapidly advance, new assessment 
opportunities and techniques are surfacing based upon these new technologies (Baker & O’Neil, 1995). Within this 
project, the use of assessments which are carefully integrated into the instructional environment, or “embedded” are 
targeted within the project design. For example, in an instructional activity where a student uses a spreadsheet to 
examine patterns of data within the mathematical modeling process, the system might record what variables the 
student is using within the spreadsheet, and perhaps the formulaic relationships between the variables. If key 
variables, or relationships have not been identified by the student, then additional instruction may be needed. 

Drawing upon the potential of new technologies to store and index student information, an on-line student 
portfolio, or related student assessment profile, is targeted as a design feature. There is indeed a rich context of 
potential assessment information which often exists within an on-line or technology based learning environment, 
and the technology itself can indeed be a very useful tool in the organization of such information (Mathies, 1995). 

In fact, assessment variables which might be stored within the context of such a student profile are quite numerous. 
These variables can include a wide variety of student performance information. Some examples include the quality 
of the questions asked within electronic dialogue with the teacher or peers, the speed of response within a simulation 
environment, the approach used to set up on-line experiments to test data, the content information self-selected by 
the student to review. Student self-assessment can also be very rich within this context, and students might reflect 
periodically upon their own levels of understanding. 

It is recognized within the design process being undertaken in the project, that any assessment will of 
course have some inherent degree of error in examining or predicting student understanding. An important 
component of the current prototype design planning in the project then is to try to identify potential “nodes” of 
student understanding, or related “nodes” of student misconception, within the content area of acceleration, based 
upon previous work of researchers in this topical area. We have defined a “node” to essentially be a key point 
within a student’s understanding related to a particular content area or process. For example, within the acceleration 
content area, such a node may be something as simple as recognizing that the student now understands that velocity 
is changing over a period of time. It is recognized that some student presence at a particular node of understanding 
may initially be less defined or “fuzzy”, until the system has adequate data from the student to determine whether a 
particular level of understanding or “node” has been truly achieved. 



Design Principle 6) The adaptive instruction will assist students in a systematic learning process, by carefully 
targeting instruction based upon their current levels of understanding. 

The design of the project seeks to ensure that students will work from current levels of understanding (or 
achieved nodes as mentioned earlier), and are able to access content information as they are ready for it. The ability 
to move easily and systematically through content is an important component of any successful online instructional 
endeavor, and particularly when faced with the mathematics discipline (Harvey and Chamitski, 1 998). For this 
design component, the project is building upon previous successes and expertise already established within the 
CLASS project (Communications, Learning, and Assessment in a Student-centered System) underway at the 
University of Nebraska at Lincoln. 



Design Principle 7) The adaptive learning system will strive to assist students in the learning process , by acting as 
a non-threatening coach or assistant, which patiently helps them clarify their thinking process, examine possible 
approaches to the problem, and test possible solutions. 

Within the design philosophy and process being undertaken in the project, student control is perhaps the 
most important design feature being incorporated. The vision for the project is one in which the student helps 
initiate, monitor, and direct their own learning process. The independent nature of the mathematical modeling 
process makes this a key design feature needed for any system which strives to assist in the modeling process 
(Smith, 1997). In fact, as described by Smith, the first independent run through the modeling process is often the 
most difficult. The education design within this project is paying particularly attention to this typical difficulty. 
Thus, the project seeks to assist students in learning how to initiate a mathematical modeling endeavor by helping 
assist their choice of modeling subtask, presentating the subtask appropriately, and delivering their the appropriate 
tutoring, and relevant instructional intervention, as needed. Facilitating such a systematic control by the student is 
also one the most difficult design challenges that we are facing in the project. 



The Challenges of Building a Prototype System 

It is indeed a daunting task to build an interactive and technology-based instructional system that truly 
follows the seven educational design principals set out by the team, and described in this paper. Each principal is 
itself an individual design challenge, and inherent with its own set of individual challenges when trying to be 
operationalized within the context of one or more components of a working system. However, the design team is 
building upon a solid foundation of earlier work, a commitment to innovative instruction and learning, and an 
ongoing dialogue with numerous colleagues. We are in essence seeking to conceptualize and examine how such 
system might contribute to all areas of the achievement cycle in mathematics education: curriculum, assessment, 
instruction, and learning (Glatthom, Bragaw, Dawkins, & Parker, 1998); a cycle which is becoming all the more 
important with the growing commitment to standards based curriculum and related student achievement within our 
country. 



A Final Thought: The Importance of Work in This Area 

As an instructional team, we have found that mathematical modeling is indeed an appropriate topic for the 
content and focus for the design of a new adaptive instructional system. It is difficult to teach mathematical 
modeling in traditional ways, and the importance of mathematical modeling within the mathematics curriculum is 
well recognized, and seemingly growing. In addition, mathematical modeling is a natural outgrowth of the reform 
efforts of many committed organizations, such as the National Council of Teachers of Mathematics, and the 
Mathematical Association of America. Although daunting, the design task we are addressing is also a very engaging 
and interesting one, and we are learning something almost every day about how students learn, and how we might 
better support them in that learning process. There is little doubt that good mathematical modeling instruction takes 
considerable effort by both the teacher and student; and that correspondingly, the development of instructional 
systems to support such a complex process will also take considerable design effort before a workable prototype or 
clear components to that prototype can emerge. However, it is also clear that in this situation, the design effort and 
energy to be expended is well worth it, as we seek to understand and help contribute to the exciting learning 
opportunities represented by new technologies, and new approaches to the learning process. 
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Abstract This paper describes part of a research programme designed to explore the validity of 
using computer mediated tests as opposed to paper-based ones for National Curriculum testing 
in mathematics at Key stage 3. Previous research in this area has focused primarily on the 
comparison between computer-based and paper-based multiple choice questions while this 
research uses constructed response questions similar to those used at present in National 
Curriculum testing. A total of 127 pupils was tested using questions based on items selected 
from National tests in mathematics at Key stage 3. The study showed that where questions 
tested similar cognitive tasks there were no significant differences in outcomes. Questions 
requiring spatial awareness were more difficult when presented in a computer environment. 

Also the study illustrated that constant care is required to ensure that computer-based questions 
do not change the level of cognitive tasks of paper-based examples. The paper demonstrates the 
potential and limitations of a shift to computer based assessment. 



Keywords: Computer-based assessment; National Curriculum assessment; Computer- 
mediated assessment, Assessment of mathematics, Constructed response. 



Introduction 

The research described in this paper is part of the ATOM (Adaptive Testing Of Mathematics) project, a co- 
operative project between the Institute of Computer Based Learning and the Graduate School of Education at 
the Queen’s University Belfast. The ATOM project has been designed to look at the utility of Computerised 
Adaptive Tests (CAT) in mathematics with particular reference to the National Curriculum assessment. For an 
account of CAT see Cowan (1997) and Green (1983). 

This paper analyses whether it was possible to obtain similar results in National Curriculum Tests (NCT) in 
mathematics at Key Stage 3 (14 years). The computer mediated tests used in this research were not adaptive as 
when comparing results between computer-based and paper-based tests, it was necessary to ensure that all 
questions were attempted by all participants. 

There are advantages in assessing students using computer-based tests rather than the traditional pen-and-paper 
tests. The advantages may include: 

• automation of test results; 

• automatic generation of progress reports for each individual student; 

• saving in teacher time; 

• minimal cost of individual tests compared to paper-based tests once the tests have been created; 

• test security - computerised question banks can be made much more secure than paper-based tests; 

• reduction in the time spent in assessment rather than in constructive learning; 

• reduction of opportunities for copying; 

Although the present advantages of using the computerised tests are mainly administrative and represent an 
economy in the use of the teachers’ time there are other factors that can to some extent contradict the positive 
impact on testing. These include: 

• the need of teachers to be confident with the technology 

• the availability of computers 

• the lack of a working record of the pupil’s work 

• The time taken to computerise and trail the questions 

Nevertheless research into computer- based testing may help clarify the direction NC assessment may take in 
the future. 
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Review of the Literature 



In a comparison of paper-based tests (P & P) with CAT, Lunz & Bergstrom (1995) found that the mean ability 
estimates, standard deviations, and pass rates were comparable across modes of administration. However, this 
comparison was made using tests delivered in multiple choice format rather than in the constructed response 
format mainly used in NCT. See Green et al (1994) for guidelines in assessing CATs. The present research 
seeks to establish whether results from computerised tests using constructed responses can be comparable to 
those results obtained from traditional pen and paper tests. 

In the United States, CAT testing is gradually replacing paper-based tests as the principal method of assessment 
in a number of subject areas. However, these CAT systems involve mainly multiple choice questions rather 
than constructed response. While it is possible to assess a number of the National Curriculum attainment targets 
with multiple choice questions, there could be problems associated with a complete change to this format. 

Gipps (1993), Murphy (1982) and Wood (1978) argue that multiple choice testing gives boys an advantage over 
girls whereas extended writing favours girls. However, short answer, constructed response type questions have 
not been found to be biased in favour of either sex. In particular, Nuttall (1987), in examining the literature to 
explore the effect of context in tests, has concluded that "assessment (like learning) is highly context-specific 
and one generalises at one's peril" (p. 1 15). Traub (1993) concurs with this view; having searched the literature 
for studies of equivalence of testing methods and reviewed nine studies in detail, he concluded that there was 
too little evidence to decide whether multiple choice and constructed response questions measured different 
characteristics (p. 38). 

Braswell and Kupin (1993) indicate in their article ‘Item Formats for Assessment in Mathematics’ that 
“multiple-choice examinations are frequently criticized because the task posed requires students to recognize a 
correct answer rather than to generate one” (p. 167). They emphasise an additional advantage of the constructed 
response question over multiple choice format in that it is possible to analyse incorrect responses to identify 
students’ misconceptions and thus enable the teacher to improve pedagogy. This certainly concurs with the 
aims of NCT not only to analyse pupils’ performance but also to assist in their further development. 

In view of 

• the concerns expressed by Gipps (1993) re gender differences, 

• the uncertainty as to whether multiple choice and constructed response questions measure the same 
characteristics ( Traub 1993), 

• the ability of constructed response answers to be used for the identification of student 
misconceptions as identified by Braswell and Kupin (1993), 

• the need to maintain validity with the present paper-based NCT, 

it was decided to maintain the constructed response format of the paper-based tests in both modes and not to 
allow open responses that could not be assessed objectively in a computer environment. 



The Research Programme 

This research investigates the implications for test construction in a computer-based testing environment. There 

are several questions that need to be answered in this context. Among the most important are the following: 

• do the questions presented on a computer lead to similar conclusions as the same questions in pen-and-paper 
tests? 

• do the questions presented on a computer test similar mathematical skills and concepts as the same questions 
in pen-and-paper tests? 

• does lack of computer experience, e.g. in keyboard or mouse skills, adversely affect scores? 

• do questions which require the use of pen and paper for calculations or planning an answer, pose more 
problems when working on a computer than they do on paper? 

• will questions which are logically structured and sequentially presented on the computer effect 
performances? 

• will the fact that pupils no longer have the opportunity to revise answers at the end of the test affect the 
results? 



Method 

In this research, tests involving a wide range of response types used in NCT of mathematics for Key Stage 3 
were administered to a group of Year 8 and 9 pupils in both paper-based and computerised format. Healy et al 
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(1995) describe how these mathematical tests were calibrated using more than 1000 experienced teachers and 
13,000 pupils using a multi-session Angoff (1971) procedure. 

Two tests of 12 questions 1 , spanning the levels 4, 5 and 6 were constructed. Each contained 5 questions from 
Level 4 , 3 from Level 5, and 4 from Level 6 (the expected level of the pupils lay between levels 4 and 5). The 
Level 6 questions were included in order to examine a wider range of response types than was possible using 
Levels 4 and 5 only. 

A computerised version and a paper-based version of each test were produced. In a few cases the questions had 
to be changed slightly for the conversion to computerised format but in the main the items have face validity - 
i.e. they seem equivalent in both the presentation and the response handling of the item; viz. typing a response 
instead of writing it, using a mouse click to select an item instead of marking it. However, the computerised 
tests used progressive revelation i.e. multi-part questions were revealed sequentially. Also on the computer test, 
while pupils could review and change their response while answering each question, they could not review the 
entire test at the end as they could on the paper-based test. A CAT system, due to its adaptive nature, does not 
support a review facility. 

A total of 127 pupils (four classes from each of Years 8 and 9) was tested in the four tests, which were held on 
consecutive days. The pupils were almost equally divided between Year 8 (62) and Year 9 (65) and there were 
70 males and 57 females. All the classes tested were of mixed ability. Half of the students in each year did the 
computer-based test first and the remainder did the paper-based test first. This order was reversed for the 
second test. 

Analysis of Overall Results 

Effect of computer experience 

None of the students could be classified as complete novices since they had all completed a one year course in 
IT (one hour per week). Over 80% said they had no difficulty using keyboard or mouse and the remainder had 
only slight difficulty - this was associated with a scale drawing question which is discussed in detail later. 

Comparison of scores 

The results were analysed using the statistical package SPSS 7.0 for Windows . shows the overall 
frequencies: of the total of 127 pupils, 124 sat computer test 1, 121 sat paper test 1, 1 16 sat computer test 2 and 
108 sat paper test 2. The mean percentage marks for each version of the test vary from 56.61% for paper test 1 
to 36.89% for computer test 2, with a relatively large standard deviation. In both cases the result for the paper- 
based test is higher than that of the computer-based test. 





N 


Mean% 

mark 


Std. 

Deviation 


Minimum 
% mark 


Maximum 
% mark 


Valid 


Missing 


computer 1 


124 


3 


52.79 


16.50 


17.86 


100.00 


paper 1 


121 


6 


56.61 


14.92 


10.71 


92.86 


computed 


116 


11 


36.89 


18.00 


.00 


83.33 


paper 2 


108 


19 


45.29 


19.16 


4.17 


95.83 



Table 1: Overall results 

Considering the possible effect of the testing order first, it was found that while those who did the paper-based 
test first obtained better results on both tests than those who did the computer-based test first, this result was not 
significant. 

Further analysis of the overall results, using a paired samples t-test (see Error! Reference source not found.) 
shows that the difference in mean scores on the computer-based test 1 compared to paper-based test 1 is 
significant at the 1% level (p < 0.001), while the difference is more significant for computer-based test 2 
compared to paper-based test 2 (p < 0.0001). Thus, while results obtained using the different media are broadly 
similar, the significant difference between them suggests further analyses be made of individual questions 



1 Copies of the Tests may be obtained from the authors at ICBL, The Queen’s University of Belfast 




Table 2: Analysis of results from computer-based and paper-based tests using paired samples t-test 



Comparison of results by NCT level of attainment 



When each NCT level of attainment is considered separately, there are 10 questions from Level 4, 6 questions 
from Level 5, and 8 questions from Level 6. Table 3 shows that the mean mark is approx. 69% on the computer- 
based level 4 questions and 72% on the paper-based version. A cut-score, as defined by Healy et al (1995), is 
the score below which a pupil can be declared a non-master of a particular level and above which mastery of the 
level can be assumed. The cut-scores on the original standard assessment tests vary from 66% to 78% with a 
mean value of 70%. While it is not possible, without using an Angoff (1971) standard-setting procedure - a 
rigorous reappraisal of all the questions included in these tests by a large number of experienced teachers - to 
establish the true cut-score for these tests, it may be worth while to examine those who obtained more than 70%, 
the mean cut-score, and those who obtained more than 65%, i.e. just below the lowest cut-score of the pen and 
paper tests. From this analysis it appears that the majority of the pupils are performing at level 4 or above. 

While there is a strong positive correlation ( r = 0.77) between the results from the two modes of test for Level 4, 
there is a significant difference (p < 0.01). 







Mean 


Number 


Std. Deviation 


Std. Error 
Mean 


Pair 1 : Level 4 


Computer 


68.77 


103 


19.53 


1.92 




Paper 


72.22 


103 


16.56 


1.63 


Pair 2: Levels 


Computer 


24.19 


103 


19.85 


1.96 




Paper 


23.79 


103 


17.64 


1.74 


Pair 3: Level 6 


Computer 


34.02 


103 


17.97 


1.77 




Paper 


43.69 


103 


19.77 


1.95 



Table 3: Comparison of results by NCT level of attainment 

With all students who did not complete all 4 tests omitted from the analysis and those students obtaining more 
than 70% on Level 4 questions classified as masters at this level, and the rest as non-masters then Table 4 shows 
that 49.5% would be classified as masters using both media, 34% as non-masters using both media, but a 
number of pupils (16.5%) would be classified differently depending on the mode of testing. Of these, almost 
10% scored higher in the paper-based test and the remainder (7%) scored higher in the computer-based test. 



Level 4 Questions 




Frequency 


Percent 


Valid Percent 


Above 70% on both media 


51 


40.2 


49.5 


Above 70% on paper, below on computer 


10 


7.9 


9.7 


Above 70% on computer, below on paper 


7 


5.5 


6.8 


Below 70% on both media 


35 


27.6 


34.0 


Missing some values 


24 


18.9 




Above 65% on both media 


60 


47.2 


58.3 


Above 65% on paper, below on computer 


12 


9.4 


11.7 


Above 65% on computer, below on paper 


5 


3.9 


4.9 


Below 65% on both media 


26 


20.5 


25.2 


Missing some values 


24 


18.9 
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Table 4: Analysis of results of NCT level of attainment 4 questions 



By taking the lower cut-score of 65% similar results are obtained - while a larger percentage is classified as 
masters (58.3%) on both media, 16.5% of pupils are still classified differently depending on the mode of testing. 
The presence of a significant difference between the results suggests the examination of results on an individual 
question basis. 

The means for both the other levels were low, (see Table 3) approx. 24% achieved Level 5 for both modes of 
testing, 34% achieved the computer-based test for Level 6 test and 44% for the paper-based version. Since the 
vast majority of the pupils were non-masters at these levels it is not possible to analyse the results as has been 
done for Level 4. 

Times taken to complete tests 

The average time taken for each test was roughly similar (see Table 5) - the means varied from 15.45 minutes 
for the first computer test to 17.79 for the second and 18.74 for each of the paper-based tests. In each case, the 
mean time taken for the computer-based tests was shorter than for the paper-based. 

Despite the relatively small difference in times taken to complete the tests using computer compared to paper, 
many students cited “It’s quicker doing tests on a computer” as a reason for preferring computer-based tests to 
paper-based ones. Perhaps the immediacy and novelty of the medium contribute to this impression. Shorter 
completion time has obvious benefits for the teacher as well, in that less class time is spent in assessment. 











Std. 


Std. Error 






Mean 


N 


Deviation 


Mean 


Pair 


Time for 










1 


Computer 
test 1 


15.45 


109 


4.16 


.40 




Time for 
Paper 
test 1 


18.74 


109 


6.10 


.58 


Pair 


Time for 










2 


Computer 
test 2 


17.79 


101 


4.30 


.43 




Time for 
Paper 
test 2 


18.74 


101 


4.45 


.44 



Table 5: Differences in times taken for the different modes of test 

Students’ Opportunity to Review the Test 

While a few students (4 out of 1 17 respondents) mentioned the inability to review work at the end of the test as 
a disadvantage of the computer-based test, observation showed that the review, when it took place, consisted of 
a brief glance back through the pages. The mean time taken for paper test 1 was 1.5 minutes and for test 2 only 
0.8 minutes. Forty-eight percent (48%) of pupils did no review for test 1, and a further 20.5% spent less than 
1 .5 minutes on the review. In only a few cases did a child use the review to attempt to answer a question that 
had not been answered previously, and in all of these cases the answer given was incorrect. During the review, 
no pupil changed an answer that was already written. These findings were unexpected, as most teachers assume 
that the possibility of reviewing answers is important and that many students do avail of it. 



Conclusions 

From an analysis of the work of students in both test modes, it was shown that changing from free response to 
multiple choice altered the level of abstraction within the cognitive task. However this change did not always 
result in different outcomes in the two test modes. When results differed, it was normally easier for students to 
obtain correct responses in the computer test. This need to alter the form of responses will become redundant as 
more powerful computers become available and as expertise grows in task setting in a computer environment. 



As will restrictions on students review. Although this research illustrated that 14-year-old students did not 
review their work and review restrictions did not affect their results. 

When questions were similarly presented in both modes, similar results were obtained (see example page). 
However, in questions where spatial awareness was required differences occurred even though the questions 
were similarly presented and the level of the cognitive tasks was similar. These questions proved to be more 
difficult for students to obtain a correct answer when working on a computer 
In conclusion this study showed: 

• Spatial awareness questions presented on a computer are more difficult than on paper. 

• Care must be taken if changing from free response to multiple choice questions 

• Students tended not to review their work 

• Students having to use pen and paper to plan their work when using a computer test did not affect 
results. 

• More research is necessary to further clarify the similarities and differences between test modes. 
The growth and increasing complexity in National Curriculum testing with increasing demands on teachers’ 
time necessitates renewed interest in assessment. The computer can provide a timesaving and efficient 
mechanism for scientific assessment. Well-chosen and carefully graded batteries of mathematical examples 
could significantly simplify and reduce the commitment of teachers to the process of assessment. However the 
computer is purely the means of monitoring such tests. It is not in itself the answer but a means of creating 
efficient and effective means of assessment. 

This paper has illustrated some potential for the computerisation of NCT. It has identified some weaknesses in a 
shift from purely pen and paper tests to a computerised test. The potential of such a shift is enormous but there 
are many problems to be addressed before a complete change is contemplated. Nevertheless, none of the 
problems illuminated in this project is insurmountable and although still theoretical, CAT plots a direction that 
NCT may take in the not so distance future. 
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Abstract: Twelve college science majors enrolled in introductory biology participated in two in-depth 
clinical interviews in which they verbalized while working with an award-winning computer simulation of a 
complex biochemical process, photosynthesis (Logal Corporation 1994). Their verbalizations during this 
and other cognitive tasks led to the identification and categorization of gaps that exist in their conceptual 
frameworks. Gaps fell into two major categories: propositional gaps and processing gaps. The graphic 
decoding gaps discussed in this paper comprise one category of the processing gaps. Graphic decoding gaps 
included gaps in icon-decoding and gaps in graphic literacy skills. Icons in the simulation for sugar output, 
photorespiration, oxygen production rate, flow lines, Calvin cycle and the radiolabel button were 
erroneously decoded. Gaps in participants’ graphic literacy skills included design convention gaps, 
orientation gaps, and representation gaps. 

Introduction 

This paper discusses our findings about gaps in graphic decoding habits of college biology students. It is part of a 
larger study of gaps in conceptual frameworks for a complex biochemical process, photosynthesis. We define gaps 
as sites in a learner’s conceptual framework in which concepts are not meaningfully linked, and therefore 
propositions fail to form. Gaps that hinder meaningful knowledge building may also reside in the declarative 
knowledge that underlies more automatized procedural skills such as one’s skill in decoding graphic representations. 
The ultimate objective of this research was to elucidate how learning about biochemical processes occurs so that 
instruction can be adapted, especially instruction which addresses salient visuospatial aspects of learning. This study 
is also significant in that it utilized a novel approach to studying learning with computers: elicitation of participants’ 
explanations and predictions during their interactions with an acclaimed computer simulation of a scientific 
phenomenon (Griffard & Wandersee 1999). Twelve students participated in two in-depth clinical interviews in 
which they interacted and verbalized while working with an award-winning computer simulation of photosynthesis 
(Photosynthesis™ , Logal Corporation 1994). Their verbalizations during this and other cognitive tasks led to the 
identification and categorization of gaps that exist in their conceptual frameworks. Gaps revealed by verbal analysis 
(Chi 1997) fell into two major categories: propositional gaps and processing gaps. The graphic decoding gaps 
discussed in this paper are one category of the processing gaps. 

Photosynthesis is a biochemical topic taught in most introductory college biology courses, and it has the reputation 
of being difficult to learn. Biologists consider photosynthesis to be the most important biochemical reaction on Earth 
(Campbell 1996) because it fixes carbon from an inorganic form into an organic form needed by all living things. 
Meaningful understanding of photosynthesis requires integration of knowledge about light, thermodynamics, 
organic chemistry, plant anatomy, plant cytology, cellular ultrastructure and stoichiometry. All of these require 
abstract thinking about structures and processes — with limited macro-scale, visual referents. It is possible that some 
learners’ difficulties with the topic are due to weak visual literacy skills. This can prevent their meaningful 
understanding of spatial orientation and multiple, nested frames of reference in which the process occurs. Poor 
visual literacy skills seem to hinder exploitation of potentially powerful instructional graphics such as those 
employed by simulation software. A study of these cognitive and visuo-spatial gaps seems necessary if teaching 
scientists who employ graphic representation are to improve the learning that occurs in introductory science courses. 
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The overall theoretical framework for this study is based on the Human Constructivist learning theory (Mintzes, 
Wandersee, & Novak 1997). Traditional instructional materials and the computer simulation used in this study 
depend heavily on graphic representation of selected organismal and biochemical aspects of photosynthesis. Thus 
visual literacy and the ability to decode the related graphics probably influence the degree of meaningful learning 
that occurs. For this reason the study was also informed by theory about the visual aspects of cognition, including 
visual literacy and Paivio’s Dual-coding Theory of memory (Braden 1996). 



Design and procedures 

This qualitative, multiple case study involved 12 college biology students at a major state university, six of whom 
were "above average," and six of whom were "average or below" according to grade point average. Half were 
enrolled in Dr. Corey’s section and half in Dr. Reese’s section of "Bio 101." To aid the reader, pseudonyms indicate 
professor (first letter C or R), ability (second letter H or A), and ethnicity. Primary data were drawn from videotape 
recordings of cognitive paths taken by participants completing specially designed tasks during two clinical 
interviews conducted before (Phase 1) and after (Phase 2) instruction. Each interview lasted from one to two hours. 

Participants explained aloud as they completed the tasks (Chi 1 997), which included item sorting, term sorting, and 
co-concept mapping, and a significant set of tasks based on the computer simulation of photosynthesis. The tasks 
based on the simulation had the participants explain and predict events depicted in outputs, graphs, and icons in the 
simulation’s leaf and mechanism windows as the result of actions they took. One such task was to obtain the 
maximum photosynthesis rate possible and to think aloud while doing so. Tasks that provided data for this paper are 
explained in more detail in the context of the findings. These tasks yielded valuable insight into the cognitive 
processing of the information in the graphics as well as clues as to how uninitiated students working alone with this 
simulation software decode these graphics in order to encode propositions about photosynthesis. 

Instantiations of all gaps were identified in multiple passes through the interview transcripts, and were indexed into 
an emergent typology. The identified gaps were categorized over numerous iterations until a full typology of the 
gaps emerged. Only the graphic decoding gaps in that typology are discussed in this paper. The qualitative data 
analysis package, NUD.IST tm (1994), facilitated transcript and multiple datastream management, and supported 
theory building during analysis (Richards & Richards 1994). 

Findings 

Graphic decoding gaps fell into two categories: gaps in icon decoding, and gaps in graphic literacy skills (Fig. 1). 
Icon decoding gaps were evident when participants made erroneous assumptions about the meaning of individual 
icons and their positions in the windows of the simulation. These were especially evident when participants 
responded to the recurrent task of explaining what was happening in the window. Gaps in graphic literacy skills 
were evident when participants relied on fallible graphic decoding habits that led them to make erroneous 
assumptions about the process represented in the simulation. 



Icon decoding gaps 

Icons in the simulation windows included those for stomates in the leaf, membrane channels, the Calvin cycle, 
oxygen, carbon dioxide, light, water and proton flow, and radiolabels. Also represented graphically were a leaf 
cross-section, gauges for sugar output and oxygen output, and sliders to change light conditions, humidity, 
temperature, water input and carbon dioxide input. 

Icons representing photorespiration, Calvin cycle, oxygen production rate, sugar output, flow lines radiolabel and 
ATPase block were decoded in error (Tab. 1), which caused them to make erroneous inferences about 
photosynthesis. Although photorespiration is a wasteful side-reaction of photosynthesis (represented in the 
simulation’s mechanism window as an input of oxygen into the Calvin cycle), all 12 participants failed to recognize 
this when they identified the icons representing photorespiration as the location where the (required) oxygen is 
coming into photosynthesis. This is incorrect since oxygen is a product (not required reactant) of photosynthesis. 
The participants frequently decoded graphics in a way that indicated the graphics had elicited their constructs for 
aerobic respiration instead of photosynthesis. The simulation’s icon for photorespiration and its prominent position 
in the mechanism window exacerbated that misretrieval. 



Figure 1: Categories of graphic decoding gaps. 

Another icon that was improperly decoded was the sugar output gauge. Its position at the edge of the leaf suggested 
to nine of the 12 participants that it represented where sugar is excreted from the leaf to the environment (Tab. 2). A 
cartesian graph of photosynthesis was also misunderstood. The title of this running graph was written as "02 
Production Rate." These six participants merely read it as "Production Rate," not understanding the significance of 
02 until the researcher suggested that the 2 should be subscripted. Once read as "0 2 Production Rate," all 
participants understood that oxygen production was being represented. This gap is directly due to a flaw in the 
graphic design. A fourth misunderstood icon was the circle in the gauge windows representing radiolabel buttons. 
This circle, when clicked, simulated radioactive tagging of the molecule with an isotope of a carbon or oxygen atom. 
Five of 12 participants believed this circle represented an O for Oxygen. This was evident when they repeated the 
statement, "water and oxygen are going into the leaf." The significance of the dark blue background of the Calvin 
cycle and the black and white flow lines were also misunderstood by a significant number of participants. 



Icon 


Freauencv 


Photorespiration 


12/12(100%) 


Sugar secretion 


9/12 (75%) 


Oxygen production rate 


6/12 (50%) 


Radiolabel button 


5/12 (42%) 


Calvin cycle 


5/12 (42%) 


Flow lines 


3/12 (25%) 



Table 1. Types and frequencies of icon decoding gaps. 



It is acknowledged that many of the icon decoding gaps identified were simple processing errors that participants 
would have self-corrected upon more careful, persistent engagement with the simulation. However, that they made 
these inferences at all in their first encounter with the simulation indicates a responsibility on the part of graphic 
designers and instructors to monitor how users decode icons. Some of the icon-decoding gaps can be attributed to 
poor design by the software developer (e.g,, 02 production rate), and some might be considered unavoidable due to 
constraints of graphic design and space use (e.g., position of photorespiration in window). 
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Charles 


I’m still not happy with what the sugar is doing. . .because it looks like it’s leaving the leaf 
through the.... leaf. 


Cheryl 


I really don’t know what the sugar would come in the form of if it’s on the outside. 


Carlos 


The sugar is. . .1 don’t think they’re excreted. Like they don’t drop a sugar pellet! It’s stored in 
the leaf. 


Caroline 


It looks like it but I don’t think they are. 


Cathy 


The sugar is coming out. It looks like the top of the leaf but I’ve never noticed sugar coming 
out of a leaf before. 


Rhea 


It’s taking in water and carbon dioxide, and, hmph, it’s giving off sugars and it’s giving off 
oxygen. 


Raul 


. . .Sugars leaving the leaf, this seems bizarre. . .1 would have thought it would have been kept 
there. 


Randy 


I see water pouring into the leaf, carbon dioxide coming in through the right bottom comer. 
Sugars look as though they’re exiting to the left, and oxygen is also exiting to the upper right. 


Rashad 


...It’s leaving. ...Where, Ido not know. 



Table 2. Participant decoding of sugar output in Phase 1 interview. 



Graphic literacy skills 

This category of graphic decoding includes graphic-use habits that hinder meaningful learning from graphics. Gaps 
in graphic literacy skills fell into several categories: design convention gaps, representation gaps and orientation 
gaps. Participants exhibited design convention gaps when they expected design features such as shape, color and 
position to apply consistently throughout the simulation. When Chanda tried to decode the ATPase block icon, she 
was reluctant to say it was a channel because she expected the proton flow line to switch from the ATPase to the 
new channel, which was a reasonable expectation. 



Chanda 

Researcher 

Chanda 

Researcher 

Chanda 



Well I was going to say that, but then they’re [hydrogen ions] still not moving out, so... 
You would have expected what to happen? 

The hydrogen ions to go through that [new channel]. 

For the black and white [flow] line to be able to move? 

Yeah. 



Caroline’s difficulty with orientation also may have been related to her expectations of consistency in graphic 
design. In the simulation’s "A Delicate Balance" task, she had trouble inferring that carbon dioxide, like oxygen, can 
enter and exit plants depending on light conditions. However the graphic was inconsistent because it showed 
separate input and output flow lines to and from the oxygen meter, whereas only one flow line was shown for the 
carbon dioxide meter which merely changed direction according to the net direction of carbon dioxide movement. 
Raul also expected consistency in Phase 1 when trying to infer the significance of the proximity of the relative 
humidity meter to the oxygen input meter in the mechanism window. At the bottom of the same window, the 
proximity of the water input to the oxygen output is significant. He was misled by trying to apply the same rule 
when inferring the other could be significant too: "Ah! the relative humidity might control the 0 2 up here." Charles 
inferred that the elongated oval at the bottom of the mechanism window represented the stem instead of the 
thylakoid membrane. This suggested that he thought it defensible for a graphic designer to mix scale within a single 



graphic without providing a referencing tool, like telescoping, to guide the user. 

Participants exhibited representation gaps when they assumed that the model or graphic they encountered faithfully 
represented the true number and spatial arrangement of the biological phenomenon under consideration. One 
manifestation of such face value inferences is the icon decoding gap discussed later in which participants assumed 
because of the position of the output meter that plants secrete the sugars they produce. Similarly, Randy said "the 
carbon dioxide is inputted through the side of the leaf, somehow through the layers of the leaf," and that inputs and 
outputs entered and exited only on the sections of the leaf where arrows in the graphic were pointing. In Phase 2, 
Rhyan made an assumption that because carbon dioxide and oxygen were illustrated entering and leaving different 
stomata shown on the leaf surface that this could mean that stomata can somehow be specialized to allow in or out 
only one of the gases. Likewise, Cheryl’s choice of words when explaining the mechanism window indicated she 
may have viewed the positions of the cycles to be fixed where they are in the representation. 

Cheryl OK, this is the thylakoid. What’s happening is, OK, you’ve got light coming in and 

you’re beginning your light reactions, and in your light reactions you make ATP here 
that’s going in, and you make NADPH which is coming in this way. So they’re coming 
in from opposite ways, they’re going to the Calvin cycle... 



One kind of representation gap was designated a single representative gap, inferring that a single representative icon 
means there is but one such structure/event in the real phenomenon. Although each icon may be intended to 
represent hundreds if not hundreds of thousands of the structure it represents, participants do not always make this 
inference. In Phase 2, Caroline assumed that each thylakoid has "its own ATPase," implying only one per thylakoid. 
Rhyan and Charles gave evidence that they did not have this gap. Rhyan understood that light entering the plant cell 
is "hitting all around" but it’s [only] interacting with the pigments. Charles readily assumed that a single icon for 
NADP represented hundreds of thousands of that molecule in a chloroplast. The following interchange shows that he 
understands that light is hitting the entire leaf surface and that oxygen exits all over the surface of the thylakoid, not 
only at the site of the output meter. 



Charles Well the light’s going right here [points with cursor to light arrow in mechanism window] but I mean 

presumably it’s not all happening right here for the entire leaf. 

Researcher So you think that this right here [thylakoid] represents the surface of the leaf? 

Charles Yes but just because it looks like this doesn’t mean that it’s happening like this you know. I’m sure 

oxygen is coming off here [at output meter] but I’m sure it’s coming off here and here [points 
elsewhere], all over when we saw the whole leaf picture... I mean [switching to leaf window] they 
have oxygen coming off here [at oxygen meter] but I wouldn’t think it would just come off there. 



Researcher Where else would it come off? 



Charles There, there, there, there, there [points cursor to many places on leaf surface] same place. 



In the above interchange Charles showed he had no single representative gap, but he did give evidence of an 
orientation gap when he thought the elongated thylakoid was the leaf surface. Orientation gaps were defined as the 
inability to process information provided in a graphic or between graphics so as to mentally place the interacting 
structures and processes in a workable arrangement in 3-D space. Cathy also misunderstood the thylakoid membrane 
representation in the mechanism window. Her attempt at visual correspondence between the leaf and mechanism 
windows led her to believe it represented the stem of the plant, Rhea believed the mechanism window was an 
overlay of the leaf window, as evidenced by her explanation that the mechanism window portrayed "the same cycle 
[as the leaf window], it’s just very. ...thorough now." When trying to get oriented in the mechanism window she 
looked for an icon that would orient her: "Where’s the 0 2 that it gives off?" Before Raul identified the photosystem 
icons in the thylakoid membrane with a popup, he thought that they represented stomata in the leaf surface. All the 
participants showed evidence at some point in the interviews that they were not properly oriented. One particular 
kind of orientation gap relates to how the participants perceived the structures and processes represented in the 
simulation to be nested . Randy’s attempt to visually nest the structures was evident in Phase 1 when explaining 
where light interacts with the parts of photosynthesis. 

Randy I figure that this [Calvin cycle] is more inside than this is [thylakoid space], [incorrect] 
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Researcher 



More inside what? 



Randy More inside the leaf. Just because it’s a little boxed in area. I don’t know if that’s any good 

reason, or logic or not. 



The text of the simulation in Phase 2 explains how the compartments of the cell and chloroplast are nested in living 
plants. 

Simulation The chemical substance which gives the plant its green color, the chlorophyll, is concentrated 
in the chloroplasts. The membranes in the chloroplasts are arranged in pocket-like structures 
called thylakoids. The light reactions take place in the thylakoid membrane. Each chloroplast 
contains many thylakoids. 



After reading the passage aloud, Cathy admitted, "That part’s confusing. I have to like write it on paper, everything 
is inside everything, you know what I mean?" Rashad made an error seen frequently with students that may indicate 
failure to regard levels of nestedness. When explaining proton pumping in Phase 1, he said "Protons, I think they are 
pumped out of the cell." A similar careless error was made by Chanda when she described protons as being found 
"in the nucleus of the cell." Rhea also called protons "parts of the cell that are positively charged." It seems likely 
that this misretrieval across scales is due to a cue common to both the cellular and atomic frames of reference 
("nucleus"). Students do not seem to attend to nestedness when leaping across scale. When Rhea was asked where in 
the leaf is the mechanism of photosynthesis occurring, she was charting new cognitive territory. 



Researcher 

Rhea 

Researcher 

Rhea 

Researcher 

Rhea 



Can you tell me where this [mechanism] is going on relative to the leaf window? Where is 
this? 

Where is it in the leaf? 

Or where is it happening? 

In the leaf 

In the leaf? OK, just anywhere in the leaf? 

Um...I’ve never thought about any of these questions before... 



After leading questions she was able to say that the mechanism window portrays cellular events. Rhonda, who had 
the lowest photosynthesis literacy level of all participants, showed her inattention to scale and nestedness when she 
summarized events in the mechanism window as "all just working together, [ ] they just went back to what the plant 
was." "The plant" does not identify her level of organization, just as "in the body" fails to identify scale when less 
mindful students say "where" a particular physiological process occurs. 



Summary 

The above results suggest numerous heretofore unrecognized graphic decoding gaps that exist in college biology 
students’ conceptual frameworks. Icon decoding gaps and gaps in graphic literacy skills such as orientation and 
representation were observed and analyzed. This study also furthers the use of computer simulations to elicit data 
that can be used to understand conceptual frameworks (Griffard & Wandersee 1999). It begins to raise awareness of 
visuospatial learning gaps and moves the profession toward a comprehensive typology of gaps in conceptual 
frameworks. 
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Abstract: The explosion- like distribution of worldwide data networks has changed and formed 
our life with lasting results. Surely the education sector at our universities and schools is 
substantially affected by this development. Unfortunately the development and distribution of 
cooperation supporting systems, i.e. tools that are not only like the WWW geared to the passive 
consumption of information, is still in its infancy. Following, the research project STeam 
(structuring information in a team) of the Heinz Nixdorf Institut deals with the conception and 
development of new learning scenarios and infrastructures which are adapted to the advanced 
“interactive” level of the WWW, enabling the user to explore and design their learning 
materials cooperatively. 



The WWW- More Than a Library Without Index ? 

At the turn of the ending twentieth century new media as well as learning- and information systems are 
widely spread over training and further education programs of the most different disciplines. "Virtual 
universities" and "multimedia" were the declared slogans for countless offensives against the education system. 

The most of the learning- and information systems are characterized by a passive spread of information, 
e.g.: WWW, printing on demand. This development is based on the idea of individually learning persons that 
with the help of the new technology are enabled to explore studying units from at home according to their own 
pace and predilection. Thus most of the hypermedia systems are designed either as printing on demand service 
(WWW) or as simple repository for the execution of animations (CD-ROM). Even the structure and the 
assignment of learning materials to each other is in a static way determined by the authors of the web pages. 

As learning mostly takes place within social context the use of technology has to make special 
contributions to this aspect of the learning situation. Furthermore on the part of the learner the perceiving and 
storing, that is to say the understanding and acknowledgement of meanings, conditions, descriptions and models 
is accompanied by the process of relating these different aspects. Students must develop the ability to approach a 
problem from individual points of view; they have to discover them for themselves, understand them and relate 
them to each other. This process is supported by the intensive discussion about different sources of knowledge 
including the active work on them, for instance, the marking and the comment on passages of the text or their 
personal summary. 

The communication of the learners' with each other is enabled and formed by the most different 
infrastructures. Hypermedia databases, the approaches of computer supported cooperative learning (CSCL) or 
even internet technologies like e-mail, WWW, etc. can serve as transport layers for the hypermedia flow of 
information. It is the objective of the work-group “Computers and Society” to establish an infrastructure which is 
as efficiently and intelligently designed as possible to guarantee the new media support for this cooperation. The 
quality of an infrastructure is represented by its usability, its every-day suitability and its level of reducing 
occurring discontinuities in the use of electronic media. These discontinuities in the transport of multimedia 
contexts, e.g. the technologically caused change of a used media into another media has to be reduced under all 
circumstances. Discontinuities in the use of media especially appear while attempting to blend synchronous 
communication forms into asynchronous interaction techniques. 

Learners use a broad spectrum of tools and methods while tele-working or even in learning situations 
that require their presence to transfer lecturing papers, like documents, transparency sheets or offers of the 




WWW into their own context of learning. At the same time the learners communicate with each other, thus 
conveying contexts, interchange them or reach an agreement on certain posed questions. 

This process is made more difficult clinging to the existing concepts, because all systems that are used 
on a large scale, like classical WWW servers show a document structure which can be absolutely called flexible 
on the part of the author, but on the part of the user they appear rigid. Following on from the described problems, 
the vision of using “Collaborative Virtual Environments” (CVEs) in teaching and the connection of document 
oriented systems with event oriented systems was and will be an object of research for some time, (see Masinter, 
L. & Ostrom, E. (1993), Dieberger A. (1997), Benford, S. D., Greenhalgh, C. M. & Lloyd, D (1997) and MITRE 
(1999)). The respective approaches take the most different directions and take on diverse shapes: If, e.g., primary 
synchronous abilities are stressed, the realization of a Shared- Whiteboard-Metaphor would provide a solution 
(see Roseman, M. & Greenberg, S. (1996a) and Roseman, M. & Greenberg, S. (1996b)). Other approaches 
connect avatar worlds, like active worlds with internet information systems like the BSCW-system (see Huxor, 
A. (1998)). Finally the interest of research is concentrated on the process of learning, i.e. the transport of learning 
information within MUDs 1 itself, like for instance the learning and adventure worlds of A. Bruckman or B. 
Slator (see Bruckman, A. (1997), Slator, B. M. & Hill, C. (1999)). 

Within the STeam system standard web technologies are combined with the possibilities inherent in 
MUD technologies. Web technology is characterized by the use of large, worldwide distributed and connected 
document stocks. Some advanced but purely asynchronous systems, like for instance, Hyperwave (see Andrews, 
K., Kappe, F. & Maurer, H. (1995)) make it possible for the user to establish personal access to these documents 
as well as to put them at somebody else's disposal. A further dimension of flexibility is offered by MUDs which 
enable the user to design and change the working-places and conditions while the system is operating. The 
STeam idea as a CVE consists of a room oriented world (see Henderson, A.J. & Card, S.A. (1985)), which is 
subdivided into public as well as private areas. Public areas serve as storage and exchange places for freely 
available information and documents; the private areas form the actual group working environment. The rooms 
are equipped with the most different objects, which depict for instance other users, documents or further 
references. It is possible to manipulate these objects and to structure them newly. An administration of user 
rights ensures that all objects and rooms are at the disposal of a defined user group. This important central idea 
constitutes the basis for the establishment of virtual working environments in which groups can meet each other 
about particular subject areas. Thus real existing social contacts between students are reflected by the work with 
the system. For this reason the connections between the rooms are not organized in a real-world metaphor but 
reflect the semantic structure of the subject area. Building the heart of the STeam architecture an event oriented 
and object oriented server in connection with a database administrates information about changes within the 
rooms. Therefore a person who enters the room is informed about the documents and objects which are located 
in the room. Furthermore the server has to store the manipulations regarding the objects. The document access 
within the server is realized via HTTP, the protocol of the WWW as well as the FTP. Consequently the 
implementation of a STeam integrated modified HTTP server was necessary. 

Tools were designed for the user (e.g. the STeam-Client) that allow an easy and comfortable interaction 
with the server. A graphical interface which visualizes the relevant room with all its objects for the user, is 
developed by the use of the platform independent programming language Java. The upload of new or modified 
documents into a room on the server is made possible in most different ways, both over the STeam-Client and 
over any extern tools (FTP). Based on an initial feasibility study the STeam approach was subject to a complete 
redesign and to a consequent further development in the last years. 

The STeam Architecture - Learning Media and Subject of Learning All In One 

On the sides of the system architecture the STeam system is subdivided in the STeam-Client, the 
STeam-Server and a database. In this connection the STeam-Server is regarded to be the heart and control center. 
Within the STeam-Server user and room structures are administrated, the communication between users is 



1 MUDs are network-able programs, which are based on a client-server-architecture. Thus many users with different 
computer systems at various locations are able to participate in the games. MUDs can on the one hand be accessed by 
any number of users, on the other hand the exclusive access variant restricts the number of users; here authorized 
players, so called wizards, limit the participation to a defined user group. The communication flows are free, but they 
can be controlled as well as manipulated by the game leader, as far as the course of the game requires it. 
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